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Abstract 

This  dissertation  considers  the  problem  of  robustly  stabilizing  systems  modeled 
on  infinite-dimensional  state  spaces  using  finite-dimensional  controllers.  In  partic¬ 
ular.  the  controllers  considered  in  this  research  are  assumed  to  be  linear  quadratic 
Gaussian  (LQG)  based  controllers. 

This  research  first  uses  a  direct  approach  to  demonstrate  the  existence  of 
finite-dimensional  LQG  based  controllers  that  stabilize  the  nominal  system.  Once 
the  existence  is  proven,  the  rest  of  the  research  focuses  on  ways  to  analyze  the 
robustness  of  the  controller.  It  is  pointed  out  that  the  exponential  growth  constant 
of  the  semigroup  generated  by  the  system  A  operator  is  not  the  only  measure  of 
robustness,  nor  is  it  the  best  one. 

Several  types  of  perturbations  are  considered,  including  bounded,  relatively 
bounded,  additive,  and  multiplicative.  As  a  result,  several  approaches  to  analyzing 
robustness  are  devloped.  Direct  analysis  using  results  from  functional  analysis  is 
accomplished,  followed  by  a  recent  approach  called  the  optimal  projection  equation 
approach,  and  then  //x  techniques  are  used  to  develop  a  sufficient  condition  for 
robustness  in  the  presence  of  multiplicative  perturbations  of  the  plant  transfer  func¬ 
tion.  It  is  pointed  out  that  each  approach  can  be  used  to  account  for  different  types 
of  perturbations.  No  one  approach  seems  able  to  deal  with  all  perturbation  types. 

A  major  development  in  this  research  is  the  new  interpretation  of  the  linear 
quadratic  Gaussian  /  loop  transfer  recovery  technique  (LQG/LTR)  for  the  case  of 
reduced  order  controllers.  It  is  demonstrated  that  the  technique  can  be  interpreted 
as  modeling  system  uncertainty  through  the  added  noise  term  rather  than  tuning 
to  recover  a  desired  loop  transfer  function. 

Also  contained  in  this  research  is  a  sufficient  condition  for  which  the  LQG/LTR 
technique  can  be  extended  to  the  entire  class  of  problems  considered.  The  devel- 
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Robust  Finite-Dimensional  LQG-Based  Controllers 
for  a  Class  of  Distributed  Parameter  Systems 


/.  Introduction 


1.1  Background 


A  constant  concern  of  engineers  designing  control  systems  is  whether  or 
not  a  feedback  controller  will  maintain  stability  of  a  closed-loop  system  in  spite  of 
all  possible  plant  variations,  i.e.  stability  robustness.  Plant  variations  may  be  the 
result  of  modeling  errors,  disturbances,  component  failures,  or  changes  in  operating 
conditions.  A  system  that  is  designed  to  be  stable  around  a  set  of  nominal  conditions 
may  or  may  not  remain  stable  with  plant  variations  present.  It  is  uncertainty  about 
the  plant  that  forces  one  to  use  feedback  control  instead  of  open-loop  control  [43]. 

Classical  stability  margins  such  as  gain  and  phase  margins  provide  a  partial 
description  of  how  much  variation  a  system  can  tolerate  before  instability  occurs. 
However,  they  do  not  provide  a  complete  description  of  a  system’s  robustness,  as  is 
available  through  the  characterization  of  the  closest  distance  to  the  critical  point  of 
a  Nyquist  diagram  or  Nichols  chart,  or  similar  graphic  descriptions.  For  the  case  of 
single-input  single-output  (SISO)  systems,  several  useful  design  tools  exist  [25,  49] 
that  enable  the  designer  to  determine  stability  robustness  of  a  control  system  prior 
to  its  implementation.  For  multiple-input  multiple-output  (MIMO)  systems  the 
tools  are  not  quite  as  well  developed.  One  measure  of  stability  robustness  that  has 
been  widely  used  is  the  singular  value  [30,  35].  Though  the  singular  value  often 
leads  to  overly  conservative  robustness  characteristics,  attempts  have  been  made  to 
reduce  its  conservatism  by  the  use  of  structured  singular  values  [32].  Nevertheless, 


the  singular  value  does  provide  a  designer  with  a  tool  by  which  to  evaluate  stability 
robustness  of  a  controller  for  a  MIMO  system. 


In  the  case  of  distributed  parameter  systems  (DPS),  very  little  is  known  about 
how  to  define  stability  robustness.  Most  of  the  current  research  tries  to  design  con¬ 
trollers  that  will  achieve  exponential  stability,  and  then  define  stability  robustness 
in  terms  of  the  magnitude  of  the  exponential  time  constant  [20,  21,  55,  23,  24,  58, 
59,  60].  However,  as  pointed  out  by  example  [51],  the  classical  stability  margins  of  a 
SISO  DPS  can  be  improved,  but  the  exponential  time  constant  simultaneously  may 
not  change.  Thus,  it  would  seem  that  the  exponential  time  constant  is  not  the  best 
measure  of  stability  robustness.  Also,  it  is  not  easy  to  relate  model  uncertainty  to 
the  exponential  time  constant,  but  for  SISO  systems  with  rational  transfer  functions, 
gain  and  phase  margins  can  be  related  to  model  uncertainty.  Some  recent  results  [47] 
have  shown  that,  for  exponentially  stabilizable  and  detectable  systems,  it  is  possible 
to  equate  exponential  stability  to  a  Banach  algebra  type  of  input-output  stability 
which  can  be  related  to  the  singular  value  concept  [16].  For  MIMO  systems,  the 
singular  value  can  be  related  to  model  uncertainty,  and  may  be  a  better  measure  of 
stability  robustness  than  the  exponential  time  constant. 

Much  work  has  been  done  in  trying  to  develop  stabilizing  finite-dimensional 
controllers  for  infinite-dimensional  systems  [2,  3,  4,  5,  6,  20,  55,  23,  58,  59,  60], 
but  in  every  case  the  stability  margin  used  is  the  exponential  time  constant.  Recent 
results  [51]  have  shown  how  to  extend  the  Linear  Quadratic  Gaussian/Loop  Transfer 
Recovery  (LQG/LTR)  technique  to  a  class  of  DPS.  However,  the  result  is  an  infinite¬ 
dimensional  controller  which  in  general  is  difficult  to  construct  unless  the  controller 
is  a  time-delay  system.  It  is  the  goal  of  this  research  to  develop  a  procedure  by 
which  finite-dimensional  linear  quadratic  Gaussian  (LQG)  based  controllers  can  be 
constructed  which  will  asymptotically  achieve  stability  robustness. 


This  research  will  look  at  four  techniques  to  design  robust  finite-dimen¬ 
sional  controllers  for  infinite-dimensional  systems.  First,  Schumacher’s  [58,  59,  60] 
direct  approach  will  be  used  to  design  a  finite-dimensional  LQG-based  controller 
to  achieve  a  desired  exponential  stability.  Schumacher’s  work  developed  conditions 
that,  if  satisfied,  are  sufficient  for  the  existence  of  a  finite-dimensional  controller 
that  exponentially  stabilizes  an  infinite-dimensional  system.  This  research  extends 
his  work  by  showing  that  LQG  controllers  satisfy  these  sufficient  conditions  under 
the  assumption  that  the  eigenfunctions  of  (.4  —  BKC )  are  complete  (see  Chapter 
3  for  details).  Also,  Schumacher  did  not  provide  a  proof  that  the  approximation 
of  the  infinite-dimensional  controller  obtained  using  his  approach,  converges  to  the 
desired  infinite-dimensional  controller  as  the  dimension  of  the  approximation  in¬ 
creases  toward  infinity.  This  dissertation  provides  that  proof  for  completeness.  It 
will  be  shown  that  the  finite-dimensional  controller  asymptotically  converges  to  the 
controller  that  would  result  from  solving  the  infinite-dimensional  algebraic  Riccati 
equations  (A.R.E.). 

Schumacher’s  approach  does  not  incorporate  robustness  into  the  design,  so 
that  one  must  analyze  the  robustness  of  the  resulting  finite-dimensional  controller  by 
using  direct  analysis  of  the  resulting  closed-loop  semigroup.  It  is  demonstrated  that 
not  only  can  the  exponential  time  constant  be  considered  a  measure  of  robustness 
with  respect  to  bounded  perturbations,  but  the  semigroup  gain  constant  can  also  be 
used  as  a  measure  of  robustness  in  the  presence  of  relative  bounded  perturbations 
(see  Chapter  3,  Section  4).  The  use  of  the  semigroup  gain  constant  as  a  measure 
of  robustness  is  a  contribution  of  this  research  based  on  theory  contained  in  Pazy’s 
text  [54]. 

Second,  because  of  the  limited  ability  to  achieve  robustness  by  analyzing  the 
robustness  after  the  design  is  accomplished,  this  research  develops  sufficient  condi¬ 
tions  for  which  the  LQG/LTR  technique  is  valid  for  the  systems  to  be  considered  in 


this  research.  By  using  a  technique  such  as  LQG/LTR,  one  is  able  to  incorporate 
robustness  issues  into  the  algebraic  Riccati  equations  which  determine  the  LQG  gain 
operators.  The  sufficient  conditions  found  in  Chapter  4  are  developed  by  using  a 
different  approach  than  that  taken  by  Matson  [51]  in  his  work.  This  different  formu¬ 
lation  may  yield  insights  into  the  LQG/LTR  technique  not  before  available,  so  that 
the  technique  can  be  extended  to  the  entire  class  of  problems  to  be  considered.  As 
an  alternative,  a  way  to  approximate  the  LQG/LTR  technique  is  developed  based 
on  the  work  of  Banks  [7],  It  is  shown  that  for  many  approximation  schemes  (such 
as  modal,  spline,  Ritz  [36],  etc.),  one  can  approximate  the  solution  of  the  infinite¬ 
dimensional  A.R.E.  with  a  sequence  of  finite-dimensional  A.R.E.s,  and  therefore  use 
a  robustness  recovery  technique  like  LQG/LTR  to  design  a  robust  finite-dimensional 
controller.  However,  as  will  be  pointed  out,  the  robustness  is  with  respect  to  the 
finite-dimensional  model  used  to  approximate  the  A.R.E.  solution.  Because  of  this, 
this  approach  will  be  considered  an  approximation  of  the  LQG/LTR  technique  for 
the  infinite-dimensional  system. 

Third,  an  approach  developed  by  Bernstein  and  Hyland  [10,  11,  46,  9,  45,  39. 
40]  called  the  optimum  projection  equation  (O.P.E.)  technique  will  be  extended  to 
allow  one  to  design  a  reduced  order  controller  that  will  be  robust  and  will  minimize  a 
cost  functional  associated  with  the  optimal  control  problem.  The  extension  is  based 
totally  on  the  work  by  Bernstein  and  Hyland  [10].  The  approach  allows  one  to 
modify  the  A.R.E.  in  such  a  way  that  robustness  is  achieved.  It  will  be  shown  that 
this  technique  gives  a  new  insight  into  the  LQG /LTR  technique,  and  therefore  allows 
one  to  achieve  robustness  without  having  to  recover  a  desired  transfer  function.  This 
new  interpretation  of  the  LQG/LTR  technique  is  a  contribution  of  this  dissertation. 

The  fourth  approach  to  designing  robust  finite-dimensional  controllers  is  the 
use  of  Hgo  techniques  to  develop  sufficient  conditions  for  robustness.  In  this  way 
one  will  have  a  tool  available  by  which  to  evaluate  the  robustness  of  a  proposed 
controller,  or  a  way  to  determine  if  a  controller  is  acceptable  given  some  knowledge 


of  the  uncertainty  one  can  expect.  The  work  of  Curtain  [22]  will  be  extended  so 
that  one  can  consider  not  only  additive  perturbations  as  she  did,  but  also  multi¬ 
plicative  perturbations  as  well.  Multiplicative  perturbations  are  preferred  since  the 
compensated  plant  transfer  function  will  have  the  same  uncertainty  associated  with 
it  as  the  uncompensated  system  does  (see  Chapter  6).  Multiplicative  perturbations 
are  also  preferred  because  they  correspond  to  the  type  of  changes  one  considers 
when  establishing  the  classical  concepts  of  gain  and  phase  margins.  The  sufficient 
condition  developed  can  be  used  as  an  analysis  tool  by  which  the  finite-dimensional 
controller  can  be  evaluted,  or  one  can  use  the  approach  to  design  finite-dimensional 
controllers  that  are  not  LQG-based,  as  demonstrated  by  Curtain  [22]. 

1.3  Problem  Class 

The  class  of  problems  addressed  in  this  dissertation  is  the  set  of  infinite¬ 
dimensional  systems  of  the  form 

i(t)  =  Ax(t)  + Bu(t)  +  Gu-(t),  x0  =  x(0)  e  D(A)  (1) 

y(t)  =  Cx(t)  +  ri{t)  (2) 

where  the  control  vector  u  is  in  the  input  space  U  =  L2{[0,  oc);  3R  V  }  ,  x  is  an  element 
of  a  Hilbert  space  Ti,  y  is  an  observation  vector  which  is  an  element  the  output  space 

Y  =  ,  and  w  and  r)  are  white  Gaussian  noise  terms  with  realizations  in  the  spaces 

Y  and  Ti  respectively.  The  strength  of  the  dynamics  noise  term  w  is  described  by 
the  positive  semi-definite  operator  Qa,  and  the  strength  of  the  measurement  noise 
term  y  is  described  by  the  strictly  positive  operator  Rj  (these  operators  will  be 
discussed  more  in  Chapter  2).  The  operator  Qj  used  in  the  Kalman  filter  design 
will  be  chosen  so  that  Qj  =  GQ0G *,  where  G*  denotes  the  adjoint  of  G.  x (t)  will 
be  denoted  simply  as  x  (and  similarly  for  the  other  functions),  and  the  following 
assumptions  are  made: 


1.  A  is  the  infinitesimal  generator  of  a  Ca  semigroup  (i.e.  strongly  continuous) 
T(t)  on  a  real  separable  Hilbert  space  (Hilbert  space  with  a  countable  or¬ 
thonormal  basis)  Ti  [24],  Seperable  Hilbert  spaces  are  needed  in  Chapter  3  to 
prove  the  existence  of  finite-dimensional  LQG-based  controllers,  and  in  Chap¬ 
ter  4  to  establish  sufficient  conditions  for  extending  the  LQG/LTR  technique. 

2.  B  is  a  bounded  linear  operator  from  3?^  to  'H. 

3.  C  is  a  bounded  linear  operator  from  'H  to  lStN . 

4.  G  is  a  bounded  linear  operator  from  the  Hilbert  space  Ti  to  H. 

5.  The  spectrum  of  A  (denoted  cr(A))  is  discrete. 

6.  The  system  is  exponentially  stabilizable  and  detectable  [24]. 

7.  The  eigenvectors  of  A  are  complete. 

8.  The  system  is  minimum  phase  (i.e.  no  transmission  zeros  in  the  right-half 
plane). 

9.  A  satisfies  the  spectrum  decomposition  assumption  [59], 

10.  The  restriction  of  A  to  the  stable  subspace  H,  satisfies  the  spectrum  deter¬ 
mined  growth  assumption  [24]  and  generates  an  exponentially  stable  semi¬ 
group. 

The  first  eight  assumptions  were  made  by  Matson  in  his  research  [51].  The  last 
two  assumptions  are  added  by  Schumacher  [59]  to  allow  finite-dimensional  compen¬ 
sators  to  be  designed.  Therefore,  this  research  has  made  these  same  assumptions. 
Assumption  (1)  is  a  standard  assumption  made  in  the  semigroup  approach  to  op¬ 
timal  control  for  infinite-dimensional  systems.  The  fact  that  the  Hilbert  space  Ti 
is  real  is  not  restrictive  since  every  real  Hilbert  space  has  a  complex  extension,  say 
He,  that  is  related  to  H  in  the  same  way  that  CN  is  related  to  S?‘v  (where  CN  is  an 


N-dimensional  complex  space,  and  is  an  N-dimensional  space  over  the  real  num¬ 
bers).  Also,  most  of  the  system  models  for  physical  systems  can  be  well  modeled  on 
real  Hilbert  spaces.  The  results  of  this  dissertation  are  based  on  real  Hilbert  spaces. 
Although  they  are  true  for  real  Hilbert  spaces,  it  is  believed  that  they  are  true,  or 
can  be  easily  extended,  to  complex  Hilbert  spaces.  Assumption  (2)  requires  that 
the  control  enters  the  system  in  a  distributed  way  and  not  via  boundary  control. 
Though  the  infinite-dimensional  phenomenon  of  boundary  control  is  interesting,  in 
many  real  situations  control  is  applied  through  a  finite  number  of  actuators  act¬ 
ing  at  specific  points  in  the  system.  Thus,  distributed  control,  described  using  a 
bounded  B  operator  on  a  finite-dimensional  input  space,  models  many  real  prob¬ 
lems.  Similarly,  assumption  (3)  requires  that  observations  of  the  system  state  occur 
in  a  distributed  way  and  not  via  point  observations.  Since  observations  normally  oc¬ 
cur  through  a  finite  number  of  sensors,  which  typically  are  not  point  sensors,  this  is 
not  a  restrictive  assumption.  Assumptions  (2)  and  (3)  are  both  commonly  made  in 
control  theory.  Assumption  (4)  is  made  in  order  to  apply  results  available  in  LQG 
control  theory.  One  would  not  expect  noise  to  enter  a  system  in  an  unbounded 
fashion. 

Assumption  (5)  is  another  standard  assumption  in  LQG  theory  and  is  satisfied 
when  the  resolvent  (A  1  —  A)~l  is  a  compact  operator  for  some  A  (E  p{A)  (where  p{A) 
denotes  the  resolvent  set  of  the  operator  A).  This  includes  a  large  class  of  systems 
described  by  partial  differential  equations  on  a  bounded  domain  or  by  functional 
differential  operators  describing  delay  equations  [59].  Within  this  class  there  are 
generators  with  only  finitely  many  eigenvalues  to  the  right  of  a  vertical  line  in  the 
complex  plane,  and  there  are  generators  with  infinitely  many  eigenvalues  to  the 
right  of  any  vertical  line.  As  a  rule,  the  operator  A  is  an  elliptic  operator  and  has 
eigenvalues  whose  real  parts  tend  to  -oo,  for  parabolic  and  retarded  systems,  and  so 
these  types  of  equations  will  generally  satisfy  assumption  (9).  On  the  other  hand, 
hyperbolic  equations  and  equations  of  neutral  type  have  infinitely  many  eigenvalues 
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in  a  vertical  strip  ,  and  so  they  will  satisfy  assumption  (9)  only  if  this  strip  is  to  the 
left  of  a  desired  u>  before  compensation  is  applied  [59]. 

Assumption  (6)  is  a  standard  assumption  and  includes  a  large  number  of  lin¬ 
ear  time- invariant  systems  [51].  The  same  assumption  is  usually  made  in  finite¬ 
dimensional  situations.  Assumption  (7)  will  be  necessary  to  prove  the  existence  of  a 
finite-dimensional  controller.  This  assumption  is  quite  common  in  partial  differen¬ 
tia]  equations,  and  solving  equations  using  the  method  of  eigenfunction  expansion  is 
based  on  it  [59].  Assumption  (8)  is  made  because  LQG/LTR  theory  has  only  been 
established  for  minimum  phase  systems.  Finally,  assumption  (10)  is  necessary  to 
use  results  developed  by  Schumacher  in  proving  the  existence  of  finite-dimensional 
controllers.  Also,  this  assumption  allows  one  to  determine  stabilizability  and  de¬ 
tectability  of  the  entire  system  by  restricting  attention  to  a  subspace  of  the  entire 
state  space.  The  next  section  gives  an  example  of  a  problem  that  satisfies  the 
assumptions. 


1.4  Example 

Ignoring  the  noise  terms,  an  example  of  a  DPS  that  satisfies  these 


assumptions  is  the  one  dimensional  heat  equation  [59],  which  is  a  parabolic  equation. 
Let  the  heat  equation  with  distributed  control  and  observation  have  the  following 
form: 


3  1  3^  m 

—G{x,t)  =  ——0(x,t)  +  J2b*(x)u>(t)  1  >  °;  0  <  *  <  1  (3) 


J /,-(<)=  /  c,(x)©(x,<)d. 
J  0 


'x  i  =  1 , 2, . . . ,  n 


(4) 


where  f>,(x)  and  c,(x)  are  known  functions  describing  the  influence  of  the  actuators 
and  sensors  respectively,  and  with  boundary  and  initial  conditions  given  by: 


£0(0,0  =  |©(i,0  =  o 


©(x,0)  =  ©0(x) 


(5) 

(6) 


i 
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For  the  state  space,  let  H  =  L2( 0, 1).  The  domain  of  the  operator  A  is  defined 

b>  2 

D(A)  =  {06H|  €  W;  JU(0)  =  ^6(1)  =  0}  (7) 

A  generates  a  C0  semigroup  and  has  a  discrete  spectrum  with  simple  eigenvalues  at 

-i2  where  i  =  0,1,2,  —  The  corresponding  normalized  eigenvectors  are  given  by 

1  »  =  0 

=  (8) 

Vzcos  ! 7TI  t  =  1,2,  ..  . 

and  they  are  a  complete  basis  for  L2( 0, 1). 

Note  that  the  systems  under  consideration  are  models  involving  process  noise 
u-  and  measurement  noise  r?  which  are  assumed  to  be  zero  mean,  white  Gaussian 
noises  with  strengths  Q0  £  £(Y ')  and  Rj  €  £(3?'v)  respectively  (i.e.  they  are 
bounded  linear  operators).  Q0  is  a  self-adjoint  positive  operator  and  Rj  is  a  self- 
adjoint,  strictly  positive  operator.  By  including  these  noise  terms,  one  can  account 
for  the  fact  that  the  system  state  is  never  known  exactly,  and  >o  an  estimator  or 
observer  will  be  needed  since  our  methodology  is  tied  to  state  feedback. 

This  research  will  assume  that  a  Kalman  filter  is  used  to  estimate  the  system 
state.  When  a  Kalman  filter  is  used  to  estimate  the  system  state  and  provide  that 
estimate  as  the  input  to  the  LQ  controller,  the  stability  margins  of  the  resulting 
closed-loop  system  may  become  arbitrarily  small  [31  ].  The  LQG/LTR  technique 
gives  a  designer  one  way  to  regain  desired  stability  robustness  of  the  corresponding 
full-state  feedback  controller.  However,  this  technique  has  not  been  extended  to  the 
entire  class  of  problems  considered  in  this  research.  Therefore,  other  approaches  will 
be  considered  as  well. 

1.5  Summary  of  Remaining  Chapters 

This  dissertation  is  organized  as  follows.  Chapter  2  contains  the  mathe¬ 
matical  background  theory  that  is  applicable  to  this  research.  Definitions  and  theory 
are  presented  that  are  used  in  chapters  to  follow. 


Chapter  3  demonstrates  that  the  LQG  solution  satisfies  the  hypothesis  of  Schu¬ 
macher’s  approach  [59]  and  therefore  finite-dimensional  LQG-based  controllers  exist 
for  the  class  of  problems  considered  assuming  that  the  eigenfunctions  of  (A  —  BKC) 
are  complete.  Schumacher  did  not  consider  a  specific  form  for  the  controller  as  is 
done  in  this  research.  It  is  also  shown  that  the  finite-dimensional  controller  con¬ 
verges  to  the  infinite-dimensional  LQG  solution  as  the  dimension  of  the  controller 
increses  toward  oo.  This  proof  was  not  given  by  Schumacher  and  is  given  in  this  dis¬ 
sertation  for  completeness.  Chapter  3  demonstrates  the  limited  robustness  analysis 
that  can  be  accomplished  once  a  finite-dimensional  controller  has  been  designed.  It 
is  shown  that  the  exponential  time  constant  can  be  used  as  a  measure  of  robustness 
for  bounded  perturbations,  and  the  semigroup  gain  factor  can  be  used  as  a  measure 
of  robustness  when  relative  bounded  perturbations  are  considered.  This  last  fact 
has  not  been  considered  before,  and  it  is  a  contribution  of  this  dissertation.  Chapter 
3  also  has  a  simple  example  problem  that  demonstrates  how  to  apply  Schumacher’s 
approach.  It  is  pointed  out  in  this  problem  that  one  must  be  concerned  with  the 
resulting  location  of  the  closed-loop  poles. 

Chapter  4  develops  sufficient  conditions  for  extending  the  LQG/LTR  technique 
to  the  entire  class  of  problems  described  in  Section  3.  The  approach  taken  is  different 
from  the  one  taken  by  Matson  [51],  and  it  is  hoped  this  new  approach  will  yield 
insights  that  will  allow  the  LQG /LTR  technique  to  be  extended  to  the  entire  problem 
class.  Chapter  4  also  looks  at  the  approximation  procedure  of  Banks  [7].  His 
approach  is  used  as  a  basis  for  an  approximation  of  the  LQG/LTR  technique  for 
those  problems  to  which  Matson  [51]  could  not  extend  the  LQG/LTR  technique. 

Chapter  5  will  consider  the  optimal  projection  equation  (O.P.E.)  approach  that 
has  been  developed  by  [10,  46,  9,  39,  40],  The  approach  will  be  extended  based  on 
the  work  of  Bernstein  and  Hyland  [10]  to  allow  one  to  put  robustness  consideration 
into  the  design  equations.  As  a  result,  a  broader  interpretation  of  LQG/LTR  will 
be  gained.  This  new  interpretation  is  a  contribution  of  this  research. 


Chapter  6  will  extend  the  work  of  Curtain  [22]  so  that  one  can  use  //<*,  tech¬ 
niques  to  evaluate  the  robustness  of  a  proposed  controller  in  the  presence  of  uncer¬ 
tainty  that  is  modeled  as  a  multiplicative  perturbation  of  the  plant  transfer  function 
rather  than  an  additive  perturbation.  Since  multiplicative  perturbations  are  often 
preferred,  this  extension  is  seen  as  a  meaningful  contribution. 

Chapter  7  will  contain  a  simple  example  problem  that  will  demonstrate  the 
four  approaches  discussed  in  this  dissertation.  The  problem  will  be  simple  so  that  a 
solution  can  be  obtained  and  is  not  meant  to  be  representative  of  a  realistic  problem. 
It  will  demonstrate  some  of  the  advantages  and  disadvantages  of  each  technique. 

Finally,  Chapter  8  will  contain  conclusions  drawn  from  this  research,  and 
will  provide  recommendations  for  future  research  in  the  area  of  finite-dimensional 
control  of  infinite-dimensional  systems.  There  are  still  many  areas  to  study  that 
could  produce  good  fruits.  The  chapter  also  contains  a  proposed  design  procedure 
based  on  the  developments  of  the  preceeding  chapters. 


II.  Background  Material 


2.1  Introduction 

This  chapter  contains  background  material  that  is  needed  in  the  chapters 
to  follow.  Section  2.2  contains  basic  theory  from  functional  analysis  as  found  in 
[41,  24,  48,  64].  Section  2.3  presents  aspects  of  semigroup  theory  and  is  taken  from 
[24,  54].  In  Section  2.4  is  the  material  dealing  with  optimal  control  and  estimator 
theory.  The  last  section,  Section  2.5,  presents  material  dealing  with  an  algebra  of 
transfer  functions  that  was  developed  by  Callier  and  Desoer  [12,  13],  The  material 
in  Section  2.5  will  be  coupled  with  recent  developments  by  Curtain  [22]  so  that  a 
sufficient  condition  for  robustness,  in  the  presence  of  multiplicative  perturbations  of 
the  transfer  function,  can  be  obtained  in  Chapter  6. 

2.2  Definitions 

Let  .4  and  B  be  arbitrary  function  spaces.  An  operator  F  is  any  map¬ 
ping  whose  domain,  denoted  D(F)  C  A,  or  codomain  (or  both)  is  a  space  of  func¬ 
tions.  An  operator  is  said  to  map  its  domain  into  its  range,  denoted  R(F).  The 
notation  used  to  denote  this  mapping  is  F  :  A  — ►  B.  Implied  in  this  notation  is 
that  D(F)  =  A ,  and  R(F)  is  a  subset  of  the  codomain  B.  The  norm  of  a  linear 
operator  in  a  normed  space  is  denoted  ||  F  ||,  and  is  defined  following  Definition 
2.2.1  [64].  The  inner  product  of  two  functions  A'  and  Y  in  an  inner  product  space 
is  denoted  {X,  Y)  .  The  space  of  all  real  numbers  is  denoted  3?  (and  C  for  the  space 
of  complex  numbers),  and  denotes  the  N  dimensional  Cartesian  product  space 
over  3?.  Normed  spaces  of  particular  interest  are  Hilbert  spaces  denoted  Ft.  Hilbert 
spaces  are  complete  inner  product  spaces. 

The  definition  of  a  bounded  linear  operator  is  [64]: 
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Definition  2.2.1:  A  linear  operator  L  :  A  —*  B  where  A  and  B  are  Banach 
spaces  (see  (64]),  is  called  a  bounded  linear  operator  if  there  exists  a  nonnegative 


constant  M  such  that 


Lx  II  <  M  II  x  II  Vi  e  A 


The  space  of  all  bounded  linear  operators  from  A  into  B  is  denoted  by  £(A,  B ). 
In  this  case  where  A  =  B,  this  is  denoted  C{A).  The  smallest  M  that  satisfies 
Equation  (9)  is  called  the  operator  norm  of  L. 

An  operator  L  is  said  to  be  continuous  at  a  point  i  6  D(L)  if  for  any  real 
number  c  >  0,  there  exists  a  real  number  6  >  0  such  that 


for  all  y  6  D(L)  such  that 


Ly  -  Lx  ||<  t 


y  -  x  ||<  6 


If  L  is  linear  operator  from  a  normed  linear  space  A  into  another  normed  linear 
space  B ,  then  [52j  demonstrates  that  the  following  are  true: 

1.  If  L  is  continuous  at  any  point  in  D(L),  it  is  continuous  on  all  of  D(L). 

2.  L  is  bounded  if  and  only  if  L  is  continuous. 


This  research  will  also  consider  unbounded  linear  operators.  Specifically  closed 
unbounded  linear  operators  are  considered  which  are  important  in  semigroup  theory. 
These  operators  are  defined  as  follows  [64]. 


Definition  2.2.2:  Let  L  :  D(L)  — ►  B  where  D(L)  is  a  subset  of  a  Banach 
space  A ,  and  B  is  also  a  Banach  space.  Let  {x„}  be  a  sequence  in  D(L)  such  that 
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xn  converges  strongly  to  x  (i.e.  lim^oo  |jxn  —  x||  =  0).  Let  Lxn  converge  strongly 
to  y  6  B.  Then  the  operator  L  is  said  to  be  closed  if  x  €  D(L )  and  Lx  =  y  for 
every  such  sequence  in  D{L).  L  is  densely  defined  if  the  closure  of  D(L)  (denoted 
D(L)  )  is  A. 

An  important  property  of  a  linear  operator  is  its  spectral  property.  Let  L  be  a 
linear  operator  with  D(L)  and  R(L )  contained  in  a  complex  linear  space  C.  Consider 
the  operator  (si  —  L)  where  s  is  a  complex  number  and  I  is  the  identity  operator. 
Then  the  following  taken  from  Naylor  and  Sell  [52]  page  412  defines  the  different 
parts  of  the  spectrum  and  resolvent  of  L  (denoted  o (L)  and  p(L),  respectively). 

Definition  2.2.3:  Let  L  be  a  linear  operator  whose  domain  and  range  are 
contained  in  a  complex  linear  space  C.  If  the  complex  number  s0  is  such  that  the 
range  of  (s07  —  L)  is  dense  in  C  and  (saI  —  L)  has  a  continuous  inverse,  then  s0  is  in 
the  resolvent  set  p(L).  The  operator  (sQI  —  L)~l  is  called  the  resolvent  operator. 
Those  complex  numbers  not  in  p(L)  are  said  to  be  in  the  spectrum  cr(L). 

The  spectrum  of  L  can  be  divided  into  three  disjoint  sets. 

1.  The  point  spectrum  of  L  is  the  set  of  complex  numbers,  s,  for  which  (si  —  L) 
is  not  a  one-to-one  operator.  This  set  is  denoted  by  P„(L).  Elements  of  the  point 
spectrum  are  called  the  eigenvalues  of  L. 

2.  The  continuous  spectrum  is  the  set  of  complex  numbers,  s,  for  w'hich 
(si  —  L)  is  a  one-to-one  operator  with  its  range  dense  in  C,  and  for  which  the 
inverse  defined  on  the  range  is  discontinuous.  This  set  is  denoted  by  C„(L). 

3.  The  residual  spectrum  is  the  set  of  complex  numbers,  s,  for  which  (si  —  L) 
is  a  one-to-one  operator,  but  whose  range  is  not  dense  in  C.  This  set  is  denoted  by 


If  C  is  a  finite  dimensional  space,  the  sets  Ca(L)  and  Ra(L )  are  both  empty. 

An  operator  may  be  positive,  strictly  positive,  negative,  or  strictly  negative 
(or  none  of  these).  The  following  defines  what  is  meant  by  positive  and  strictly 
positive  [64]  (the  definitions  for  negative  and  strictly  negative  follow  directly  from 
these). 

Definition  2.2.4:  An  operator  P  £  £(H),  where  "H  is  a  Hilbert  space,  is  said 
to  be  positive  if  ( Ph,h )  >  0  for  all  h  £  'H.  If  (Ph,h)  >  0  for  all  nonzero  h  £  H, 
then  P  is  said  to  be  strictly  positive. 

Another  term  for  positive  is  positive  semi-definite  (and  similarly  for  negative). 
Positive  operators  can  be  factored  into  the  product  of  two  operators  called  square 
root  operators  as  defined  in  the  following  definition  [41]. 

Definition  2.2.5:  Let  P  be  a  bounded  linear  positive  operator  and  let  P  be 
self-adjoint  (i.e.  P  —  P'  where  P*  is  the  adjoint  of  P).  A  self-adjoint  operator, 
denoted  P1^ ,  such  that  Pl/2  £  Cl'H)  and  pl/2pi/2  =  p (  Js  called  the  square  root 
of  P.  There  exists  a  unique  positive  operator  P1//2  for  any  such  P. 

The  existence  of  P1//2  is  proven  by  Naylor  and  Sell  in  problem  15,  page  377 
[52]  so  that  one  does  not  have  to  assume  that  the  square  root  operator  exists. 

2.3  Semigroup  Theory 

The  systems  under  consideration  are  assumed  to  be  of  the  form 

x  =  Ax  +  Bu  xa  £  D(A)  (12) 


or  by  the  associated  integral  expression 


along  with  the  output  relation 


y  -  Ci  (14) 

where  A  :  D(A)  — *  W,  A  is  a  closed,  densely  defined  operator  on  a  Hilbert  space  H 
which  generates  the  C0  semigroup  T(t)  (to  be  defined  later  along  with  D{A)),  and 
B  and  C  are  bounded  linear  operators  as  given  in  the  assumptions  in  Section  3  of 
Chapter  1.  x  is  the  state  variable  and  is  an  element  of  the  real  Hilbert  space  7i.  u 
is  the  input  control  vector,  and  y  is  the  observation  vector. 

Equation  (12)  is  a  time  invariant  evolution  equation  [24]  and  Equation  (13) 
is  the  solution  of  Equation  (12)  under  the  conditions  described  in  this  section.  A 
semigroup  approach  will  be  taken  since  this  is  a  standard  approach  toward  infinite¬ 
dimensional  systems  [18]. 

The  definition  of  a  C0  semigroup  is  [54]: 

Definition  2.3.1:  A  strongly  continuous  semigroup  of  operators  (a  C0  semi¬ 
group)  is  a  one-parameter  family  T(t),  0  <  t  <  oo,  of  bounded  linear  operators  from 
a  Banach  space  A'  into  X  which  satisfies  the  following  properties: 


T{t  +  s) 

=  T(t)T(s)  Vs,t>  0 

(15) 

7(0)  =  I 

(16) 

1!  T(l)x  —  T  || 

— »  0  as  t  — »  0+  Vx  €  A' 

(17) 

The  generator  of  a  C0  semigroup  is  defined  as  [54]: 


Definition  2.3.2:  The  operator  A  is  the  infinitesimal  generator  of  a  strongly 
continuous  semigroup  T(t)  on  a  Banach  space  X  if  and  only  if 


where  D(A )  =  {x  £  X:  the  limit  exists  }. 


When  considering  the  stability  of  infinite-dimensional  systems,  many  people 
use  the  concept  of  exponential  stability.  Consider  the  homogeneous  equation  corre¬ 
sponding  to  Equations  (12)  and  (13): 

x  =  Ax  x0  £  D(A)  (19) 

x  =  T(t)x0  (20) 

The  set  of  operators  {T{t)}  for  i  >  0,  is  a  semigroup  of  operators,  and  A  is  the 
infinitesimal  generator  of  T(t)  [54].  The  following  defines  exponential  stability  [54], 

Definition  2.3.3:  A  C„-semigroup  T(t)  is  said  to  be  exponentially  stable  if 
there  exist  constants  M  >  1  and  u>  <  0  such  that  || 7"( < ) ||  <  M ew<  Vf  £  [0,oc). 

Hence,  when  one  says  that  a  system  is  exponentially  stable,  one  means  that 
the  semigroup  generated  by  the  operator  A  in  Equation  (19)  is  exponentially  stable. 
This  makes  sense  when  one  considers  that  the  solution  to  Equation  (19)  is  given  by 
Equation  (20).  Thus,  when  a  system  is  exponentially  stable,  as  t  — »  oo  the  system 
state  will  approach  zero  from  any  initial  value  of  x(0)  £  D(A)  with  an  exponential 
decay  rate  of  u. 

One  may  consider  robustness  of  the  system  by  considering  additive  perturba¬ 
tions  of  the  operator  A.  If  B  is  a  bounded  linear  time-invariant  operator,  then  the 
following  is  true  [54]: 

||  S(t)  ||  <  ^/e(w+Af||S||)t  (21) 

where  S(t)  is  the  semigroup  generated  by  the  operator  (A  +  B).  Thus,  as  long  as  the 
perturbation  is  such  that  (ui  4-  M  ([  B  ||)  <  0,  the  system  will  remain  exponentially 
stable.  This  result  will  be  used  in  Section  4  of  Chapter  3  when  the  robustness  of  a 


finite-dimensional  controller  is  analyzed.  Note  that  an  operator  B  is  bounded  if  and 
only  if  there  exists  a  constant  K  such  that  ||  B  ||  <  K  <  oo.  This  is  why  authors 
have  used  the  exponential  time  factor  as  a  stability  margin.  The  more  negative 
u.'  becomes,  the  larger  the  perturbation  ||  B  ||  can  be  and  still  retain  exponential 
stability.  Howe%er,  one  must  question  whether  or  not  all  perturbations  can  be 
modeled  as  the  addition  of  a  bounded  linear  time-invariant  operator.  Also,  it  is 
not  clear  how  to  relate  exponential  stability  to  model  uncertainty.  As  demonstrated 
by  example  [51],  it  may  be  possible  to  adjust  a  SISO  design  for  better  gain  and 
phase  margins,  but  the  exponential  time  factor  may  not  change  at  all.  One  could 
also  change  both  gain  and  phase  margin,  and  not  affect  the  smallest  distance  to  the 
crtical  point  on  a  Nyquist  diagram,  which  demonstrates  the  fact  that  gain  and  phase 
margin  do  not  provide  a  complete  description  of  robustness.  However,  since  they 
can  be  improved  without  improving  the  exponential  stability  of  a  system,  it  appears 
that  the  exponential  time  factor  may  not  be  the  best  stability  margin  as  claimed 
by  some  [18,  20,  21, 55,  23,  58,  59,  60],  unless  it  can  be  shown  that  there  is  a  direct 
relationship  between  the  magnitude  of  the  exponential  time  factor  and  the  minimum 
distance  to  the  critical  point.  Chapter  3  demonstrates  that  the  exponential  time 
factor  is  not  the  only  semigroup  factor  that  can  be  used  as  a  measure  of  robustness. 
The  semigroup  gain  constant  can  also  be  used  as  a  measure  of  robustness  when 
relative  bounded  perturbations  are  considered  (see  Section  3.4). 

Next  the  spectrum  determined  growth  assumption  (SDGA)  is  defined.  From 
semigroup  theory  (see  [51  ]  page  18),  it  is  known  that 

sup Rt[a{A)\  <  inf{tu  €  3?  |  ||  T(t)  ||<  Meut)  =  u;0  (22) 

where  T(t)  is  a  C0  semigroup  with  infinitesimal  generator  A.  For  infinite-dimensional 
systems,  there  may  be  strict  inequality,  so  that  the  er(A)  does  not  completely  de¬ 
termine  the  growth  constant  of  T(t)  [42].  This  gives  rise  to  the  following  definition. 
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Definition  2.3.4:  An  operator  A  is  said  to  satisfy  the  SDGA  if 

sup /?e[cr(A)]  =  u.'o  (23) 

where  ui0  is  defined  in  Equation  (22). 

This  condition  holds  for  generators  of  the  following  types  [65]: 

(i)  .4  is  a  bounded  operator 

(ii)  .4  generates  an  analytic  semigroup 

(iii)  .4  generates  a  compact  semigroup  for  t  >  0 

(iv)  .4  generates  a  strongly  differentiable  semigroup  for  i  >  t0  >  0 

Condition  (i)  holds  if  .4  is  a  continuous  operator  or  a  finite-dimensional  oper¬ 
ator.  Condition  (ii)  holds  if  the  spectrum  of  the  operator  A  is  contained  in  a  closed 
sector  A  =  {A  :  arg(X  —  a)  <  0;  a  6  ^  <  <p  <  7 r}  (see  [65]  page  388).  Condition 

(iii)  generally  is  satisfied  by  A  operators  associated  with  delay  equations  or  if  the 
Banach  space  containing  D(A)  is  finite  dimensional.  Condition  (iv)  is  typically  sat¬ 
isfied  for  diffusion  equations  or  if  the  generator  is  bounded.  An  important  property 
of  these  operators  is  that  if  A  is  one  of  these  types  and  B  is  a  bounded  operator, 
then  .4  -f  B  is  also  the  same  type  of  operator  [54].  Thus,  if  feedback  is  applied 
through  bounded  operators,  the  SDGA  is  retained. 

Now  the  terms  exponentially  stabilizable  and  exponentially  detectable  will 
be  defined  [24]. 

Definition  2.3.5:  Let  _Y  and  U  be  Banach  spaces  and  let  B  €  C(L’,X). 
Also,  let  A  :  D(A)  C  X  —*  X  generate  a  Ca  semigroup  T(t).  Then  the  pair 
(A,B)  is  exponentially  stabilizable  if  there  exists  an  operator  D  £  C[X,U)  such 
that  the  operator  A  4-  BD  generates  an  exponentially  stable  semigroup  S(t)  with 
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||  S(t)  || <  A/e"*,  u  <  0.  A  +  BD  generates  a  semigroup  because  A  generates  a 
semigroup,  and  BD  is  a  bounded  linear  operator  [54]. 


Definition  2.3.6:  Let  A'  and  Y  be  Banach  spaces  and  let  C  6  C[X,Y). 
Also,  let  A  :  D(A)  C  X  — ♦  X  generate  a  Ca  semigroup  T(t).  Then  the  pair 
(A,C)  is  exponentially  detectable  if  there  exists  an  operator  G  €  £(}'',  X)  such 
that  the  operator  A  +  GC  generates  an  exponentially  stable  semigroup  S(t)  with 
II  S{t)  ||<  A/e1"',  CJ  <  0.  A  +  GC  generates  a  semigroup  because  A  generates  a 
semigroup,  and  GC  is  a  bounded  linear  operator  [54]. 

Another  definition  that  will  be  needed  is  the  definition  of  the  spectrum  de¬ 
composition  assumption  (SDA). 

Definition  2.3.7  Let  6  >  0  be  given,  and  consider  the  partitions  of  the 
spectrum  given  by 

<ru  =  {A  e  <t(A)  :  ReX  >  -6}  (24) 

crs  =  {A  €  o{A)  :  Rt\  <  — <5}  (25) 

where  the  subscripts  u  and  s  denote  “unstable”  and  “stable”  respectively,  relative 
to  the  line  at  — <5.  Then  cr(A)  =  cru(.4)  U  <7,(.4)  ,  and  for  A  the  generator  of  a  Cc, 
semigroup,  it  can  be  shown  that  (see  [24]  page  75): 

a(A)  C  {A  :  Re\  <  u;*}  (26) 

where  *J0  is  defined  in  Equation  (22). 

Then  the  following  definition  can  be  made: 


Definition  2.3.8  :  If  the  set  ou(A)  is  bounded  and  separated  from  a,{A)  in 
such  a  way  that  a  rectifiable,  simple  closed  curve  can  be  drawn  to  enclose  an  open 


$ 


set  containing  ou(A)  in  its  interior  and  <J,(A)  in  its  exterior,  then  A  is  said  to  satisfy 
the  spectrum  decomposition  assumption  [24]. 


If  A  satisfies  the  SDA,  then  it  can  be  decomposed  into  the  form  (see  [59]  page 


Au  0 

A  =  (27) 

\  0  A.  ) 

which  corresponds  to  the  state  space  decomposition  given  by  H  =  H,  ©  Hu,  where 
H,  is  stable  subspace  of  H  and  is  the  unstable  subspace  of  H.  Note  that  stability 
is  defined  by  the  choice  of  6  in  Definition  2.3.7.  Thus,  the  operators  A,  and  Au  are 
the  restrictions  of  A  onto  "H ,  and  'Hu,  respectively.  In  an  obvious  way,  one  can  also 
write  the  input  and  output  operators  as 


C  =  (CU  C.) 


By  stabilizing  the  system  partition  corresponding  to  the  triple  (Au,  BU,CU)  one  is 
then  able  to  stabilize  the  entire  system  [59].  Thus,  the  problem  becomes  a  restriction 
to  the  space  Hu.  If  Hu  is  finite-dimensional  and  A  and  A,  satisfy  the  assumptions 
of  Chapter  1,  then  [59]  ( A,C )  is  detectable  if  and  only  if  ( Au ,  Cu)  is  observable,  and 
( A,B )  is  stabilizable  if  and  only  if  ( AU,BU )  is  controllable  [59]. 

One  type  of  normed  space  of  particular  interest  is  a  Lebesgue  space,  which  is 
denoted  Z/{(a,  6);  X }  where  p  £  [l,oo),  and  A'  is  a  normed  linear  space  consisting 
of  functions  /  such  that  ||/||p  is  Lebesgue  integrable  (see  [52]  page  589).  This  type 
of  space  is  used  in  the  next  definition. 

The  following  defines  what  is  meant  by  the  mild  solution  for  a  class  of  nonho- 
mogeneous  system  equations  [24].  The  control  and  estimation  problems  will  assume 
that  the  systems  under  consideration  can  be  modeled  as  described  in  this  definition. 
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Definition  2.3.9:  Let  A  :  D(A)  C  X  — ►  X  where  X  is  a  Banach  space.  Also, 
let  A  generate  a  semigroup  T(l)  and  let  /  6  £p{[0,  oo);  .Y},  where  Lv  denotes  a 
Lebesgue  space  for  1  <  p  <  oo.  Then 


:(t)  =  T(t)x0  +  [ tT(t~s)f(s)ds 
Jo 


is  called  the  mild  solution  to  the  evolution  equation 


x{t)  =  Ax{t)  +  f(t)  x0eD{A) 


The  mild  solution  may  not  be  differentiable,  and  therefore  would  not  strictly 
satisfy  Equation  (31).  If  the  solution  to  Equation  (30)  is  continuously  differentiable 
for  t  >  0,  and  if  it  satisfies  Equation  (31)  for  t  >  0,  then  it  is  referred  to  as 
the  classical  solution.  It  is  clear  that  not  every  mild  solution  is  also  a  classical 
solution.  Notice  that  when  the  input  vector  u  6  jL2{[0,oo);  },  then  Bu  is  also  in 

T2{[0,  oo);  }  when  B  is  a  bounded  linear  operator.  Thus,  one  can  set  /  =  Bu 
in  Definition  2.3.9.  This  will  be  done  in  the  next  section.  The  optimal  control  and 
estimation  problems  can  now  be  discussed. 

2-4  Optimal  Control  and  Estimation  Theory 

This  section  presents  relevent  results  from  optimal  control  theory  and 
estimation  theory  for  abstract  evolution  equations.  The  results  are  taken  from 
Curtain  and  Pritchard  [24].  This  section  will  focus  on  the  infinite  time  problems  in 
order  to  present  results  applicable  to  steady  state  time  invariant  controllers  which 
will  be  used  in  later  chapters. 

The  system  to  be  controlled  will  be  assumed  to  be  modeled  by  the  mild  solution 
given  by 


x (t)  =  T(t)x0  +  f  T(t  —  s)Bu(s)ds  x0  £  H 
Jo 


(32) 
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where  Ti  and  U  are  assumed  to  be  real  separable  Hilbert  spaces,  B  is  a  bounded 
linear  operator  from  U  to  "W,  x0  G  H ,  and  T(t)  is  a  C0  semigroup  with  generator  A 
that  satisfies  the  assumptions  of  Chapter  1.  Also  (A,  B)  is  assumed  exponentially 
stabilizable. 

The  optimal  control  problem  is  to  find  a  control  u  G  L2{[0,oo);  U}  which 
minimizes  the  cost  functional 

J{u;x0)=f  (x{s),Qcx(s))  +  (u{s),Rcu{s))ds  (33) 

Jo 

where  the  operator  Qc  G  £(R)  is  positive  semi-definite  self-adjoint,  and  the  operator 
Rc  G  C(U)  is  strictly  positive  self-adjoint. 

Under  these  constraints,  there  exists  a  unique  optimal  control  u*  which  min¬ 
imizes  the  cost  functional  J(u]x0).  The  following  theorem  from  [24]  page  109  de¬ 
scribes  the  optimal  control  input. 
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THEOREM  2.4.1:  Let  H  and  U  be  real  separable  Hilbert  spaces  and  let 
( A,B )  be  stabilizable.  Let  Qc  be  positive  semi-definite  self-adjoint,  and  let  Rc  be 
strictly  positive  self-adjoint.  Let  B  6  C(U,W),  x0  G  H,  and  let  A  generate  a 
C0  semigroup  T(t).  Then  there  exists  a  unique  control  u*  G  L2{[0,  oc);  V]  which 
minimizes  the  cost  functional  J(u;x0),  and  u’  is  given  by 

ti*(0  =  -A’cx(t) 

where  Kc  —  R~l B’ Pc  ( B‘  denotes  the  adjoint  of  the  operator  B).  Pc  G  C(H )  is  a 
positive,  self-adjoint  operator  which  satisfies 

Pch  =  /°V*(s)(Qc  +  PcBR;'B'Pc)T(s)h)ds 

Jo 

where  T(l)  is  the  semigroup  generated  by  the  operator  (A  —  Bl\c)  and  T’(t)  denotes 
the  adjoint  of  T(t). 

Proof:  See  [24]  page  109. 
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Pc  is  also  the  unique  solution  of  an  A.R.E.  when  the  added  assumption  that 
{A,QXJ2)  is  detectable  is  made.  The  following  theorem  from  Curtain  and  Pritchard 
[24]  gives  the  result. 


THEOREM  2.4.2:  If  ( A,QXJ 2)  is  detectable  and  (A,B)  is  exponentially 
stabilizable,  then  the  following  is  true: 


V 

i 

S 


a.  The  operator  (A  —  BKC )  generates  an  exponentially  stable  semigroup. 


b.  The  operator  Pc  is  the  unique  positive,  self-adjoint  solution  of  the  following 


A.R.E. 


(Ah,Pek)  +  (Pch,  Ak)  +  ((Qc  -  PcBR;'B‘Pc)h,k)  =  0 


for  all  /i, k  €  D(A). 


Proof:  See  [24]  page  111. 


This  control  theory  is  referred  to  as  the  Linear  Quadratic  (LQ)  control  theory 
because  of  the  quadratic  cost  functional  and  the  linear  models.  The  optimal  control 
law  given  in  Theorem  2.4.1  is  called  the  LQ  regulator. 

The  optimal  control  development  assumes  that  the  state  of  the  system  is  known 
exactly  and  it  is  available  to  generate  the  control  input.  However,  since  the  state 
is  usually  estimated  from  measured  outputs  of  the  system,  and  these  measurements 
are  often  incomplete  and  noise-corrupted,  it  is  usually  necessary  to  use  an  estimator. 
The  Kalman  filter  is  one  estimator  that  can  estimate  the  system  state  from  noisy 
measurements.  It  is  the  optimum  estimator  with  respect  to  minimum  mean  squared 
error,  and  it  is  based  on  the  following  model  of  the  system. 

x  =  Ax  4-  Bu  +  Gw  x0  6  D(A)  (35) 

y  =  Cx  +  T)  (36) 


•t 


where  H  and  Y  are  real  separable  Hilbert  spaces  (Hilbert  spaces  with  countable 
orthonormal  bases),  G  6  C(Y,H)  ,  and  the  other  assumptions  of  Chapter  1  apply. 
Also,  the  operator  Q0  €  £(Y)  is  positive  and  self-adjoint  and  the  operator  Rj  G 
£(3ft,v)  is  strictly  positive  and  self-adjoint.  Q0  is  the  “strength”  of  the  white  Gaussian 
zero-mean  dynamics  noise  term  u>,  and  Rj  is  the  “strength”  of  the  white  Gaussian 
zero-mean  measurement  noise  term  tj.  It  is  assumed  that  x0,u>  and  r?  are  mutually 
independent.  Since  the  observation  space  Y  is  assumed  to  be  finite-dimensional,  the 
operator  Rj  is  nuclear  and  thus  compact  (see  [70]  page  279  for  definitions)  and  Rj1 
will  exist  (see  [24]  page  158). 

The  details  of  the  Kalman  filter  theory  for  infinite-dimensional  systems  is 
covered  in  detail  in  [24]  and  so  just  the  major  results  will  be  presented  here.  The  filter 
will  be  treated  as  a  compensator  element  without  great  concern  for  the  stochastic 
nature  of  the  problem  underlying  the  filter’s  development. 

The  steady  state  Kalman  filter  estimate  x  of  the  system  state  is  defined  by 

x  =  Ai  +  Bu  +  I\j{y  —  Cx)  (37) 

where  the  Kalman  filter  gain  operator  Kj  —  PjC'Rj1,  and  the  operator  Pj  exist  as 
the  unique  positive,  self-adjoint  solution  of  the  A.R.E.  (see  [24]  Chapter  6) 

(Pjh.  A’k)  +  (Amh,  Pjk)  +  {{Q,  -  PSC'  R]lC  Pf)h,  k)  =  0  (38) 

for  all  h,k  E  D{A‘)  where  Qj  =  GQ0Gm,  and  it  is  assumed  that  (A,  G)  is  stabilizable 
and  (A,C)  is  detectable.  By  duality  to  the  results  of  Theorem  2.4.2  for  the  LQ 
regulator,  it  can  be  shown  that  the  operator  (A  —  KjC)  is  the  generator  of  a  stable 
semigroup  [24]. 

Using  these  basic  ideas,  one  can  design  a  finite-dimensional  compensator  by 
using  dynamic  feedback  [58].  In  the  case  of  a  LQG  controller,  Figure  1  shows  that 
the  output  is  fed  back  through  a  Kalman  filter  and  2m  estimate  of  the  system  state 
is  constructed  which  in  turn  is  used  as  the  input  for  the  LQ  controller.  The  loop 
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Figure  1.  Observer- Based  Feedback  Configuration 


transfer  function  corresponding  to  the  loop  being  opened  at  point  3  is  identical  to 
the  full-state  LQ  regulator  transfer  function.  The  loop  transfer  function  obtained  by 
opening  the  loop  at  point  2  is  identical  to  the  Kalman  filter  loop  transfer  function. 
Both  of  these  transfer  functions  have  desirable  stability  robustness  properties  as 
demonstrated  in  Chapter  2,  Section  4,  of  Matson  [51],  Unfortunately,  these  points 
in  the  loop  are  not  very  meaningful,  since  they  are  internal  to  the  compensator.  Since 
the  compensator  is  designed  by  the  control  engineer,  uncertainties  are  not  considered 
to  be  a  problem  at  these  points.  The  points  that  are  physically  important  are  points 
1  and  4.  These  are  the  points  where  the  controller  interfaces  with  the  plant  being 
controlled.  Point  4  is  the  input  to  the  plant,  and  point  1  is  the  output  of  the  plant 
that  is  used  as  an  input  to  the  Kalman  filter.  At  these  points  the  transfer  functions 
are  not,  in  general,  identical  to  or  even  similar  to  the  transfer  functions  at  points  3 
and  2.  Figure  1  will  be  referenced  again  in  Section  2  of  Chapter  3. 

Kc  and  Kf  are  bounded  operators  [24]  which  can  be  adjusted  to  achieve  desired 
performance  and/or  stability.  The  Kalman  filter  and  LQG  control  law  have  as  their 
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defining  equations  respectively 

x  =  At  -fi  Bu  +  Kj{y  —  C'x)  (39) 

u  =  -A'cx  (40) 

which  can  be  equi valent ly  expressed  as 

x  =  Ax  —  Bl\cx  —  KjCx  +  Kjy  (41) 

i  =  (-4  -  BI\C  -  KjC)x  +  Kfy  (42) 


However,  the  gain  operators  Kc  and  K j  will  not  be  the  same  as  the  ones  that 
result  using  a  finite-dimensional  compensator.  Specifically,  A’/  £  £(3?N;>f)  and 
A’c  £  £('H;3?N  )  for  the  infinite-dimensional  controller,  but  for  a  finite-dimensional 
compensator  one  would  have  A'/  £  £(8L\Si*)  and  l\c  £  £(3?*; 9RN  )  where  k  is  ihe 
order  of  the  compensator  and  the  dimension  of  the  state  model  upon  which  the 
compensator  is  based.  This  research  will  view  the  LQG  controller  as  a  dynamic 
compensator,  and  apply  the  techniques  of  Schumacher  [59]  to  obtain  conditions 
under  which  a  finite-dimensional  LQG  controller  exists  that  is  an  approximation  of 
the  infinite-dimensional  one  would  get  by  solving  the  infinite-dimensional  A.R.Es. 
The  two  controllers  will  be  related  by  an  isomorphism  (see  Chapter  3),  and  the 
approximation  will  be  chosen  so  that  the  norm  difference  between  the  two  controllers 
is  sufficiently  small.  Showing  that  such  a  finite-dimensional  LQG  controller  exists 
is  just  one  step.  Next,  one  needs  to  evaluate  the  resulting  compensator  through  the 
use  of  some  sort  of  stability  margin  other  than  the  exponential  factor. 

The  work  of  Matson  [51]  extended  the  LQG/LTR  technique  to  a  class  of  DPS 
but  not  to  the  entire  class  that  is  considered  in  this  research.  The  idea  behind 
the  LQG/LTR  technique  is  to  adjust  the  loop  transfer  function  for  the  closed-loop 
system  using  an  LQG  controller  so  that  asymptotically,  the  loop  transfer  function 
approaches  the  full-state  LQ  regulator  transfer  function  (or  by  duality  the  Kalman 
filter  transfer  function).  Actually,  the  return  difference  function  associated  with 


point  1  of  Figure  1  asymptotically  approaches  the  return  difference  function  associ¬ 
ated  with  point  2  (and  similarly  for  points  4  and  3).  For  details  about  this  technique, 
one  is  referred  to  Matson’s  work  [51].  However,  since  the  technique  has  not  been 
extended  to  the  entire  class  of  problems,  other  robustness  approaches  have  been 
considered  in  this  research  as  well  as  ways  to  extend  the  LQG/LTR  technique  to 
the  entire  class  of  problems. 

2.5  Algebra  of  Transfer  Functions 

In  recent  years,  much  work  has  been  done  using  a  transfer  function 
approach  for  compensator  design  [27,  12,  13,  15,  16,  22,  26,  33,  34,  47,  67,  53,  66]. 
Callicr  and  Desoer  developed  an  algebra  of  transfer  functions  and  showed  how  to  for¬ 
mulate  linear  time-invariant  DPS  in  terms  of  this  transfer  function  algebra  [12,  13]. 
Jacobson  [47]  later  showed  that,  for  the  class  of  systems  considered  in  this  research, 
every  exponentially  stabilizable  and  detectable  state  space  representation  has  its 
transfer  function  belonging  to  this  transfer  function  algebra.  He  further  pointed  out 
that  the  SDA  must  be  satisfied  by  exponentially  stabilizable  and  detectable  state 
space  systems.  Hence,  the  assumptions  of  this  research  allow  one  to  use  this  transfer 
function  algebra. 

Because  the  problems  are  in  an  infinite-dimensional  state  space,  the  transfer 
functions  of  the  systems  will  be  irrational.  However,  the  transfer  function  algebra 
allows  one  to  handle  irrational  transfer  functions.  The  algebra  of  transfer  functions 
developed  by  Callier  and  Desoer  is  a  quotient  algebra.  A  quotient  algebra  is  an 
algebra  in  which  every  element  can  be  written  as  the  quotient  of  two  elements 
contained  in  subalgebras  of  the  quotient  algebra.  The  subalgebra  from  which  the 
denominator  elements  are  taken  is  the  subalgebra  containing  the  algebra  inverses. 
The  key  elements  of  the  algebra  of  transfer  functions  needed  to  formulate  a  DPS  in 
terms  of  this  algebra  will  be  defined  [12,  53],  In  the  following  definitions,  C  denotes 
the  space  of  complex  numbers. 


Definition  2.5.1:  For  a  G  3?,  a  function  /  is  an  element  of  A(cr)  (the  algebra 
of  Laplace  transformable  functions)  if 

0  t  <  0 

/(*)  = 

JA)  +  ZZofA*-ti)  <>0 

where 

/.  €  LU*+)  =  {/I/  :  *+  -  <\  f"  e-°V(i)\dt  <  cx>) 
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Vi  =  1,2,...  /,  €  C 
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and  <*(/  —  #,)  is  the  Dirac  distribution  applied  at  time  t  =  t,. 

Definition  2.5.2:  For  a  G  ??,  a  function  /  is  an  element  of  A_(cr)  (the  algebra 
of  stable  Laplace  transformable  functions  where  a  defines  stability)  if  there  exists  a 
o'  <  a  such  that  /  G  A(o'). 

A  better  discription  of  A(a)  and  A_(a)  will  be  given  in  Definition  2.5.3.  The 
thing  to  note  is,  by  Definition  2.5.1,  every  element  of  A{a)  or  A_(cr)  is  Laplace 
transformable,  and  A{a)  and  A_(a)  denote  the  Laplace  transforms  of  the  respective 
sets  fi.e.  A{a)  =  {f\f  G  A{a)}  ). 

Definition  2.5.3:  A™(o)  =  {f\j  G  A_(cr);/  is  bounded  away  from  zero  at 
infinity  in  Cff+)  where  Cg+  =  {s  G  C  |  Re(s)  >  a}.  /  is  said  to  be  bounded 
away  from  zero  at  infinity  in  Ca+  if  and  only  if  there  exists  r\  >  0;  p  >  0  such  that 
Vs  G  D(a,p).  \f(s)\  >  r],  where  D(cr,p)  =  (s  G  C„+  :  |s  —  cr|  >  p)  [13].  As  pointed 

*  A  A 

out  by  Callier  and  Desoer  [13],  if  /  G  A(<r0),  then  /  is  only  guaranteed  to  be  analytic 
in  the  interior  of  Cg 4  ,  and  not  necessarily  on  the  boundary.  /  may  have  singularities 
that  are  dense  on  the  boundary.  However,  if  /  G  A-(a0),  then  /  is  analytic  in  an 


open  right  half-plane  strictly  containing  .  Hence,  it  is  analytic  at  all  the  zeros 
of  /  €  C**,  and  it  has  a  finite  number  of  zeros  in  any  compact  subset  of  Cff+  [13]. 
Also,  if  /  €  A_(cr0)  and  /  is  bounded  away  from  zero  at  infinity  in  Cg+  for  some 
ox  <  <y0,  then  /  has  a  finite  number  of  zeros  in  Cg+  [13]. 

Before  proceeding  to  the  definition  of  B(cr),  one  needs  to  understand  what  is 
meant  by  the  convolution  of  two  functions  [28], 

Definition  2.5.4:  Given  two  functions  u  and  h  mapping  9R+  into  3?,  one  can 
compute  their  convolution  u  *  h  which  is  defined  by  the  integral 


(u  *  h)(t)  =  f  h(t  —  t)u(t)c1t  t  >  0 
Jo 


The  main  reasons  for  using  the  convolution  as  a  representation  for  linear  time- 
invariant  systems  are  that  under  mild  conditions  (see  [61]  page  162)  any  linear  time- 
invariant  system  can  be  represented  by  a  convolution  kernel  which  is  a  distribution, 
and  it  allows  one  to  consider  lumped-parameter  systems  and  distributed  parameter 
systems  under  one  setting. 

A  convolution  product  algebra  is  one  on  which  addition  is  defined  pointwise, 
scalar  multiplication  by  real  numbers  is  defined  in  the  normal  manner,  and  the 
product  of  two  elements  is  defined  to  be  their  convolution  [28].  B(o)  =  [A_(a)]  * 
[v4^° (<r)]~ 1  is  a  quotient  algebra  since  every  element  can  be  written  as  the  quotient 
of  two  elements  contained  in  the  subalgebras  A_(<r)  and 


Definition  2.5.5:  B(cr)  is  the  convolution  product  algebra  corresponding  to 
the  quotient  algebra  B(a)  =  (y4_(cr)]^[^4^:>(<T)]-1.  Elements  of  B(a)  can  be  expressed 
as  the  convolution  of  elements  in  A_(< r)  with  the  reciprocal  of  elements  in  A^°(a). 


The  algebra  B(cr)  is  the  transfer  function  algebra  developed  by  Callier  and 
Desoer  [12,  13].  Generally  speaking,  B(a)  represents  the  set  of  all  transfer  func¬ 
tions  under  consideration,  and  A_(cr)  represents  the  transfer  functions  defined  to  be 
“stable”.  This  leads  to  the  next  definition. 

Definition  2.5.6:  A  transfer  function  /  €  B(a)  for  some  a  £  is  said  to  be 
.4_(<7)  stable,  or  input-output  stable,  if  /  €  A-(<r). 

To  coincide  with  the  usual  notion  of  stability,  a  is  taken  to  be  less  than  or 
equal  to  zero.  It  is  pointed  out  [53]  that  convolution  kernels  (i.e.  impulse  responses) 
corresponding  to  physical  systems  are  always  real-valued,  so  that  the  generality 
of  allowing  complex-valued  kernels  is  really  not  necessary.  This  algebra  is  easily 
extended  to  multivariable  systems  by  defining  A((y)nxTn  as  a  nxm  matrix  having 
elements  in  A(<r).  Through  the  use  of  left  and  right  coprime  factorizations,  one  is 
able  to  factor  elements  of  B(o )  in  a  “minimal”  fashion  [53,  66],  A  factorization 
of  an  element  in  B(a)  is  minimal  if  it  consists  of  irreducible  quotients.  Coprime 
factorization  produces  minimum  factorizations,  and  is  discussed  in  detail  in  [66]. 
The  advantage  of  working  in  this  algebra  is  that  it  places  a  measure  of  stability 
robustness  other  than  the  exponential  time  factor  at  one’s  disposal. 

Chen  and  Desoer  [16]  have  extended  the  singular  value  concept  to  this  algebra, 
and  have  shown  that,  if  a  system  is  A_(a)  stable,  then,  for  perturbations  which  are  in 
B{a)  and  which  have  singular  values  bounded  by  a  scalar  function  for  all  frequencies 
>  0,  the  multiplicatively  perturbed  sys'em  P  (  P  =  (I  +  Mp)P,  where  Mp  is  the 
perturbation  and  P  is  the  nominal  plant)  is  also  /4_(ct)  stable  if  and  only  if 

<rmax[PCF(I  +  PCF)-'(ju>)\  <  -±-  Vu>  6  £+  (44) 

where  P ,  C,  F  are  the  transfer  functions  of  the  plant,  the  precompensator,  and  the 
feedback  compensator  respectively  (see  Figure  2).  This  condition  will  be  given  more 


Figure  2.  System  with  Precompensation  and  Feedback  Compensator 


completely  in  Chapter  6,  Theorem  6.3.4.  The  function  lm(^' )  is  a  scalar  function 
describing  the  norm  of  th  nultiplicative  uncertainty  of  the  system  as  a  function  of 
frequency,  and  <jmax  is  the  largest  singular  value  of  the  operator  PC F(1  +  PC F)~' . 
Construction  of  for  multivariable  systems  is  not  trivial.  The  bound  assumes 

a  single  worst  case  uncertainty  magnitude  for  all  channels  of  the  system.  In  this 
sense  the  uncertainty  is  unstructured.  Typically,  uncertainty  at  higher  frequencies  is 
greater  than  at  low  frequencies,  so  that  the  magnitude  of  /m(u;)  increases  as  u>  — *  oc. 

For  the  case  where  an  LQG  compensator  is  used,  one  can  put  the  observer 
based  feedback  system  of  Figure  1  into  the  form  of  Figure  2  by  letting  F  =  I  and 
C  =  I\c{sl  —  A  +  BKC  +  I\  jC)~x I\  j.  This  choice  is  made  in  order  to  correspond  to 
the  system  configuration  used  by  Jacobson  [47],  and  will  be  used  in  Chapter  6.  The 
commanded  input  is  uj.  U2  and  u3  can  be  viewed  as  disturbances  or  noise  entering 
the  system  at  the  plant  input  and  output  respectively  (they  may  also  be  considered 
as  additional  inputs  to  the  system).  Thus,  the  mulitiplicatively  perturbed  system  is 


A-{cr)  stable  if  and  only  if 


crmai[PC(l  +  PC)-'(juj)}  <  — J—  Vu;  e  £+  (45) 

For  lumped  unity  feedback  systems,  this  result  is  the  same  as  the  result  stated 
by  Doyle  and  Stein  [30].  Thus,  it  may  be  possible  to  use  the  singular  value  as  a 
measure  of  stability  robustness  instead  of  the  exponential  time  constant.  This  will 
be  used  in  Chapter  6  when  Curtain’s  work  [22]  is  considered. 

2.6  Summary 

This  chapter  has  presented  background  that  will  be  needed  in  chapters 
to  follow.  It  is  assumed  in  those  chapters  that  the  optimal  control  theory  of  Section 
2.4  has  been  applied  to  yield  an  LQG  controller  for  the  system  to  be  controlled.  It 
is  also  assumed,  except  in  Chapter  5,  that  a  finite-dimensional  controller  is  to  be 
obtained  using  Schumacher's  direct  approach  [59].  Chapter  6  will  provide  the  proof 
of  Equation  (44),  and  it  will  use  this  result  to  extend  the  work  of  Curtain  [22]. 

The  next  chapter  will  show  that  an  LQG  compensator  satisfies  the  assumptions 
needed  in  Schumacher’s  approach.  This  then  will  prove  the  existence  of  finite¬ 
dimensional  LQG-based  controllers  for  the  class  of  problems  described  in  Section 
1.3.  It  is  also  proven  that  the  finite-dimensional  approximation  converges  in  norm  to 
the  infinite-dimensional  LQG  controller  as  the  dimension  of  the  controller  increases 
toward  infinitv. 


III.  Existence  of  Finite -Dimensional  LQG-Based  Controllers 


3.1  Introduction 

This  chapter  will  use  the  approach  developed  by  Schumacher  [58,  59]  to 
prove  the  existence  of  finite-dimensional  LQG-based  controllers  for  infinite-dimensional 
systems  that  satisfy  the  assumptions  outlined  in  Section  3  of  Chapter  1.  Through¬ 
out  the  research,  it  is  assumed  that  one  is  concerned  with  improving  the  stability 
robustness  of  a  feedback-controlled  DPS.  It  is  assumed  that: 

1 )  A  Kalman  filter  is  needed  to  provide  a  state  estimate  as  an  input  to  a  LQ 
regulator  (i.e.  u  =  —Kcx). 

2)  The  LQG  controller  will  be  viewed  as  a  dynamic  compensator  which  has 
been  deisgned  by  applying  the  optimal  control  theory  of  Chapter  2. 

Thus,  it  is  assumed  that  an  infinite-dimensional  controller  has  been  designed, 
and  this  chapter  will  provide  the  conditions  under  which  a  related  finite-dimensional 
controller  exists.  This  controller  will  be  related  to  the  desired  infinite-dimensional 
controller  in  the  sense  that  the  norm  difference  will  be  “small".  Section  3.3  proves 
that  the  finite-dimensional  controller  converges  in  norm  to  the  infinite-dimensional 
controller  that  is  approximated  as  the  dimension  of  the  controller  increases  toward 
oc.  Section  3.4  dicusses  the  limited  robustness  analysis  that  can  be  accomplished 
after  the  finite-dimensional  controller  is  designed.  Section  3.5  gives  an  example  of 
Schumacher’s  approach  for  a  parabolic  system. 
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3.2  Existence  Theory 


description 


The  systems  will  be  described  by  the  infinite-dimensional  state  space 


x  =  Ax  +  Bu  -(-  Gw  x(0)  €  D(A) 


y  =  Cx  +  r)  (47) 

where  x  €  71,  u  G  3RN  and  y  £  ,  and  the  assumptions  outlined  in  Chapter  1, 

Section  3,  are  satisfied.  In  this  state  space  description,  the  state  vector  x  is  actually 
a  differentiable  H-valued  function  of  position  and  time  with  x  being  the  partial 
derivative  of  x  with  respect  to  time.  The  system  to  be  controlled  will  be  assumed 
to  have  the  following  mild  solution 

x(t)  =  T(t)x(0)  +  P  T(t- s)Bu(s)ds-,  x(0)  e  H  (48) 

Jo 

where  H  and  l’  are  real  Hilbert  spaces  and  u  €  U.  This  is  not  a  serious  restriction 


Consider  the  “compensator”  to  be  the  LQG  controller  (see  Equations  (39)  - 
(42))  which  has  the  describing  equations 

x  =  Ax  +  Bu  +  I\  j(y  —  Cx)  (49) 

u  =  — Acx  (50) 

which,  when  u  is  substituted  into  the  x  equation  gives 

i  =  (A  -  BKC  -  I\jC)x  +  Kjy  (51 ) 

where  the  controller  and  filter  gain  operators  Kc  and  Kj  are  given  by: 

KC  =  R;'B‘PC ;  KceC(H-,XN)  (52) 

K/  =  PjC'R 71;  Kj  €  £(£v;  W)  (53) 

where  Pe  and  Pj  are  strictly  positive  self-adjoint  solutions  to  the  controller  and  filter 
Riccati  equations,  Equations  (34)  and  (38),  respectively.  Note  that  the  number  of 


inputs  equals  the  number  of  outputs,  namely  N.  This  is  assumed  since  Matson’s 
procedure  has  only  been  proven  for  that  case  [51]  and  will  be  needed  in  Chapter  4. 
Also,  note  that  the  input  u  and  the  output  y  are  finite-dimensional  vectors. 

It  will  also  be  assumed  that  {A,Q\^)  is  detectable  and  (A,B)  is  stabilizable 
so  that  the  operator  Kc  will  be  unique,  yield  a  minimum  cost,  and  produce  a  stable 
closed-loop  system.  Similarly,  it  will  be  assumed  that  (A,C)  is  detectable  and 
(.4,G)  is  stabilizable  in  order  that  the  operator  Kj  be  unique,  yield  a  minimum  cost 
associated  with  the  filter,  and  produce  a  stable  filter  [24].  Figure  1  of  Chapter  2 
depicts  the  system  under  consideration. 

The  closed-loop  equations  can  be  written  in  terms  of  the  extended  space  Xe  = 
H  r  .V,  where  .Y  C  "H ,  to  get 

x  A  —BI\C  x  G  0  u' 

,  =  .  +  (54) 

x  A  jC  A  —  Bl\c  —  h  jC  x  0  K  j  tj 

or  in  terms  of  the  extended  space 

xe  =  A'X'  +  B'UC  (55) 

and  Bt  is  a  bounded  linear  operator.  The  question  to  ask  now  is,  under  what  con¬ 
ditions  will  the  operator  generate  a  stable  semigroup  when  a  finite-dimensional 
compensator  is  used?  The  following  theorem  by  Schumacher  [59]  gives  sufficient 
conditions. 

THEOREM  3.2.1:  Let  the  system  be  described  by 
x  =  Ai  +  Bu  +  Gu>  x(0)  €  D(A) 
y  =  Cx  +  r? 

with  the  assumptions  that 


i)  A  generates  a  C0-semigroup  T(t)  on  the  Hilbert  space  H 


| 


ii)  B  €  £(R‘V;W) 

iii)  C  €  £(W;»N) 


Also,  let  the  bounded  linear  operators  F  :  7i  —*  %iN  and  K  :  S?  v  — *  T-L  be  such 

that 


iv)  (.4  —  BF)  generates  a  stable  semigroup 

v)  ( A  —  KC)  generates  a  stable  semigroup 

If  there  exists  a  finite-dimensional  subspace  V  C  D{A )  such  that 

1)  (A  -  BF)x  €V  Vx  €  V 

2)  Im(  —  K)  C  V  where  Im  denotes  the  image  of  an  operator 

then  there  exists  a  stabilizing  compensator  of  order  k  =  dimV  (i.e.,  k  is  the  dimen¬ 
sion  of  V). 

Proof:  See  Schumacher  [59]  pg  109. 

For  the  case  of  an  LQG  compensator,  let  Kc  =  F  and  Kj  =  K.  Then  the 
assumptions  of  Theorem  3.2.1  are  satisfied  except  for  the  required  properties  of  the 
subspace  V.  Theorem  3.2.1  gives  a  sufficient  condition,  but  it  is  not  clear  how  to 
find  the  required  subspace  V  so  that  Im(-Kj)  C  V  and  (A  —  BKc)x  eV  Vx  6  V- 
One  can  find  Kc  and  Kj  using  LQG  theory,  but  V  is  not  as  readily  obtainable. 
Therefore,  one  would  like  to  have  some  sort  of  construction  procedure  to  find  V. 
The  next  theorem  from  Schumacher  does  just  that. 


,  --  - 
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THEOREM  3.2.2:  Let  the  system  be  such  that  A  generates  a  C0-semigroup, 
B  G  C(?HN]'H)\  C  €  £(W;3?N),  and  suppose  that  the  mappings  F  G  £CH;3?A)  and 
K  G  are  such  that 

1)  (A  —  BF)  generates  a  stable  semigroup 

2)  ( A  —  BF)  has  a  discrete  spectrum  and  its  generalized  eigenvectors  are 
complete  in  H  (i.e.  span{x  G  H\  3A  G  C  and  Bn  G  K  9  (A /  —  A)"x  =  0}  is  dense 
in  H). 

3)  There  exists  a  scalar  a  >  0  such  that  the  semigroup  generated  by  (A  — 
I\C  +  a/)  is  stable  (i.e.  (.4  —  KC)  has  an  extra  margin  of  stability). 

Then  there  exists  a  stabilizing  finite-dimensional  compensator. 

Proof:  Following  Schumacher’s  proof,  let  S(t)  be  the  semigroup  generated 
by  (.4  —  I\C).  The  growth  constant,  by  assumption  (3),  is  less  than  or  equal  to 
u >  —  6  where  Ma  =  6  and  u>  <  0.  The  constant  M  >  0  is  the  constant  such  that 
II  5(f)  ||<  <  A/e(u,-2*<.  Note  that  since  ui—6  <  u—  |  then  <  e*u,-5*<  . 

For  any  operator  K  :  -♦  Ti  such  that  ||  K  -  K  ||<  A/-1  ||  C  ||_1  |,  then  the 

operator  {A  -  KC)  will  generate  a  semigroup  S(<)  and  (A  -  KC)  generates  5(f) 
with 

||  5(f)  ||<  A/e("+AfllA'-X'llllc||-f)t 
II  5(f)  ||<  M e("+MM*1  llcllllcir1  - f)‘ 

II  5(f)  ||<  A/ ewt 

so  that  ||  K  —  K  || <  c  where  e  =  A/-1||C||-1  f-  Then  the  perturbation  of  K,  K, 
is  such  that  the  perturbed  operator  will  still  generate  a  stable  semigroup.  Now, 
pick  an  orthonormal  basis  for  say  {e,},  and  define  g,  =  h  ei  for  i  =  1,2, ...  ,n. 
Note  that  g<  G  'H .  Since  the  generalized  eigenvectors  of  (A  —  BF)  are  complete  (i.e. 


span{x  €  "H|  3A  6  C;3n  6  K  :  (A  1  —  A)nx  =  0}  is  dense  in  7i),  then  for  every  g,, 
there  exists  a  linear  combination  of  finitely  many  eigenvectors  {xtJ},  j  =  1, 2, . . . ,  Ar, 
(where  the  double  subscript  notation  is  used  to  emphasize  the  dependence  on  g,) 
such  that  ||  g,  —  atjx>j  ||<  e  for  suitable  numbers  atJ(i  =  1,2,.  ..,n;  j  = 
1,2, .. .  ,Ni).  Then  to  every  pair  of  indices  (ij)  there  exists  a  AtJ  £  C  and  a  n,;  6  K 
such  that  (AtJ  —  {A  —  BF))n,1Xi}  =  0.  In  other  words,  every  eigenvector  xtJ  has  a 
corresponding  eigenvalue  AtJ  which  may  have  finite  multiplicity. 

Then  define  the  subspace  V  as 

V  =  span{{ A.j  -  (A  -  BF))kxtJ} 

i  =  1,2, . .  .,n;j  =  1,2,. . .  ,A't;  k  =  0, 1, . . .  ,n,-j  -  1 

Then  V  is  clearly  finite-dimensiona!  and  D(A  —  BF)  =  D(A).  Also,  since  V  is 
spanned  by  the  generalized  eigenvectors  of  (.4  —  BF),  then  V  is  invariant  under 
(A  —  BF)  ([59]  pg  112,  [8]  pg  257).  Now,  write  g,  =  o,jXtJ  and  define  the  linear 

*  A  A 

transformation  K  :  — >  H  by  A'e,  =  g,  and  note  that  A'(6j,  62, . . . ,  6n)  =  btg,. 

Then,  /m(A')  C  V'  and  also  ||  K  —  1\  ||<  e  where  c  =  (l/2)Jl/_1  ||  C  ||-1  6  so  that 
(.4  —  1\C)  generates  a  stable  semigroup.  This  comes  from  the  fact  that 

||  (A'-A-)e,  ||  =  ||  A'e,  -  A'e,  || 


and  noting  that  [52] 


=  11  9.~  9>  11  =  11  9 .  -  J2q']X,j  || <  t 


I\  —  I\  ||=  sup  ||  (A'  -  A')e, 
ll«.!l=i 


Then  by  Theorem  3.2.1,  with  this  choice  of  V,  K ,  and  K  a  finite-dimensional  sta¬ 
bilizing  compensator  exists  of  order  =  dimV .  Q.E.D. 


Notice  that  this  theorem  gives  us  a  way  to  construct  V ,  but  there  is  no  upper 
limit  on  the  order  of  the  compensator.  Although  Schumacher  demonstrates  that 


the  dimension  of  \'  may  be  small  for  many  problems  [59],  for  other  problems  in 
which  the  compensator  order  is  constrained,  the  dimension  of  V  may  have  to  be 
too  large.  Since  there  is  not  an  upper  limit  on  the  dimension  of  V,  one  would  not 
know  this  without  trying  to  solve  the  problem.  The  question  left  to  resolve  is,  are 
the  conditions  of  Theorem  3.2.2  satisfied  using  an  LQG  compensator?  ( A  —  BI\C) 
generates  a  stable  semigroup  and  with  u)  <  0  one  can  find  an  q  >  0  such  that 
(/l  -  KjC  -f  al)  generates  a  stable  semigroup.  The  requirements  on  (A,B,C)  are 
satisfied  by  assumption.  Therefore,  one  needs  to  ask  whether  or  not  the  spectrum 
of  (A  —  BKC)  is  discrete  with  complete  eigenvectors.  If  one  can  show  this  to  be 
true,  then  Theorem  3.2.2  yields  that  a  finite-dimensional  LQG-based  compensator 
will  exist  which  will  exponentially  stabilize  the  system.  First,  consider  whether  the 
spectrum  of  (.4  —  BKC)  is  discrete.  The  spectrum  of  A  is  discrete  and  B  :  SJ,V  — ►  H 
and  l\c  :  'H  — +  Thus,  BI\C  has  finite  rank.  Then,  as  proven  in  Kato  [48] 

Chapter  4,  Theorems  4.6.2  and  4.6.5,  the  spectrum  of  {A  —  BKC)  is  discrete. 

The  final  question  is,  are  the  eigenvectors  of  (.4  —  BKC)  complete?  Since 
BKC  has  finite  rank,  it  has  only  a  finite  number  of  eigenvalues  associated  with  it. 
say  £.  Now  by  assumption,  A  satisfies  the  spectrum  decomposition  assumption, 
and  there  are  only  a  finite  number  of  eigenvalues  to  the  right  of  any  vertical  line 
which  separates  stable  and  unstable  regions  (i.e.  the  j uj  axis).  Also.  {A,B)  is 
assumed  stabilizable  which  means  that  (Au,i?u)  must  be  controllable,  as  proven  in 
Schumacher  and  Curtain  [24,  59].  (Au,  Bu)  is  the  restriction  of  (A,  B)  to  the  finite¬ 
dimensional  subspace  Hu.  Hu  is  the  subspace  spanned  by  the  eigenvectors  associated 
with  the  eigenvalues  in  the  unstable  part  of  the  complex  plane  (i.e.  the  right  half 
plane).  Since  Kc  stabilizes  (A,  B)  then  it  must  be  that  (Au,  Bu)  is  controllable.  Thus, 
when  rank  BKC  equals  dim  7iu ,  the  eigenvalues  associated  with  the  subspace  can 
be  arbitrarily  perturbed  (for  proper  choice  of  Ac)  so  that  none  of  the  eigenvalues  of 
(Au  —  BUKC)  coincide  with  the  eigenvalues  of  A,,  and  thus  the  eigenvectors  associated 
with  (Av—BUKC)  and  A,  are  complete,  as  shown  by  Sakawa  [56],  A,  is  the  restriction 


of  .4  to  the  subspace  "H,,  where  Ti,  =  7iu  ®  'H,. 


Hence,  completeness  of  the  eigenvectors  of  A ,  the  finite  rank  of  BKC,  and  the 
assumption  that  (A,  B)  is  stabilizable,  imply  that  the  eigenvectors  of  (A  —  BKC)  can 
be  made  complete  if  A'c  is  chosen  properly.  It  will  be  assumed  that  this  has  been 
done  during  the  LQG  design.  This  is  not  viewed  as  a  real  problem  since  ( AU,BU ) 
is  controllable  so  that  the  unstable  eigenvalues  can  be  placed  at  desired  locations  in 
the  left-half  plane.  Thus,  one  can  maintain  the  same  number  of  distinct  eigenvalues 
as  the  operator  A ,  and  for  most  problems,  it  is  felt  that  this  will  yeild  a  set  of 
complete  eigenfunctions  since  A  has  complete  eigenfunctions.  Then  {A  —  BI\C)  will 
satisfy  assumption  2  in  Theorem  3.2.2  so  that  a  finite-dimensional  compensator 
exists  which  will  exponentially  stabilize  the  system  for  some  uj  <  0  (not  necessarily 
an  arbitrary  u>  <  0). 

3.3  Convergence 

Although  it  has  been  shown  that  a  finite-dimensional  stabilizing  LQG 
based  controller  exists,  it  has  not  been  shown  whether  or  not  this  approximation 
converges  to  the  desired  infinite-dimensional  LQG  controller  as  the  dimension  is 
increased.  The  following  theorem  will  be  needed  in  proving  convergence. 

THEOREM  3.3.1:  Let  G  E  £(H)  be  the  generator  of  an  exponentially 
stable  semigroup  S(t).  Then,  G_1  exists  and  is  a  bounded  operator. 

Proof:  If  one  can  show  that  A  =  0  is  in  the  resolvent  set  of  G,  then  that  will 
mean  G-1  exists  as  a  bounded  operator  in  the  Hilbert  space  H  [54]. 

Recall  that  a  linear  operator  G  is  the  infinitesimal  generator  of  a  C0  semigroup 
S(t)  satisfying  ||  S(<)  ||<  A/ewl  for  u>  <  0  if  and  only  if  the  resolvent  set  p(G)  contains 
the  ray  ]w,oo[  (where  ]a,6[  is  the  standard  notation  to  denote  a  ray  of  the  real  line 
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between  a  and  6)  and 

ll«(A;G)||  £(TT^)  va>“ 

where  R( A;  G)  is  the  resolvent  operator  (see  Pazy  [54]  Theorem  5.3).  Then  since  G 
generates  an  exponentially  stable  semigroup,  u>  <  0  and  A  =  0  is  in  p(G).  Hence, 
G-1  will  exist  as  a  bounded  linear  operator.  Q.E.D. 


Now,  the  finite-dimensional  compensator  is  of  the  form 

i  =  A'  z  -f  My  (5G) 

u  =  Lz  (57) 

where  for  the  case  of  a  LQG  compensator  described  by  Equation  (42), 

N  =  R{A  -  BKC  -  kjC)R-'  (58) 

M  =  RKj  (59) 

L  =  - KCR -1  (60) 


R  is  an  isomorphism  such  that  R  :  V  — ►  H’,  and  I\j  is  the  approximation  of  Kj 
obtained  as  in  Theorem  3.2.2.  Since  the  Theorem  3.2.1  only  requires  that  Kj  have  its 
image  contained  in  a  finite-dimensional  space,  there  is  not  a  need  to  approximate  I\c. 
However,  the  isomorphism  R  will  restrict  the  domain  of  l\c  to  a  finite-dimensional 
space  so  that  1\CR  is  a  finite-dimensional  operator.  V  is  the  finite-dimensional 
space  such  that  (A  —  BKc)x  €  V  Vz  6  V  and  7m(A'/)  C  V ,  and  W  is  the  finite¬ 
dimensional  space  that  the  compensator  state  z  is  an  element  of.  In  terms  of  LQG 
notation,  Equations  (56)  and  (57)  can  be  written  as: 


i  =  R(  A-  BKC  -  kjC)R~xx  +  RKjy 

(61) 

u  =  —KcR~'x 

(62) 
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The  describing  equation  for  the  finite-dimensional  compensator  transfer  function  is 
given  by 

Ck  =  FR~\sI  -  R{A-  BF  -  GC)R~l)~'RG  (63) 

where  in  the  LQG  case  F  =  Kc  and  G  =  h'j  (so  G  =  K j).  Let  Zk  =  {A  —  BF  —  GC). 
The  fact  that  R  is  an  isomorphism  yields 

Ck  =  FR~l(sI  -  RZkR~l)~lRG  (64) 

=  F[(sl  -  RZkR-l)R]~lRG  (65) 

=  F\{$R- RZk))~'RG  (66) 

=  F[R-\sR-  RZk)]~'G  (67) 

=  F(sI-Zky'G  (68) 

This  is  equivalent  to 

Ck  =  F{sl  -  {A  -  BF  -  GC))~'G  (69) 

Now.  it  will  be  shown  that  as,  k  — >  oo,  then  lim^oo  Ck  =  C,  where  C  is  the 
transfer  function  of  the  infinite-dimensional  LQG  compensator. 

THEOREM  3.3.2:  The  finite-dimensional  LQG  compensator  transfer  func¬ 
tion  Ck  converges  to  the  desired  infinite-dimensional  C  compensator  as  k  — ►  oo  . 

Proof:  Recall  that  G  :  — >  H  and  G  :  8?^  — »  %tk  where  k  is  the  dimension  of 
the  finite-dimensional  compensator.  By  construction  of  G,  ||G  —  G||  — ►  0  as  k  — >  oo 
so  that  the  only  unresolved  question  is,  will 

{si  -{A-  BF-  GC))"1  -*  {si  -{A-BF-  GC))-1 

a s  k  —*  oo?  One  sees  that  this  is  true  from  the  following  argument.  Let  Zk  = 
{A  —  BF  —  GC)  and  let  Z  —  {A  —  BF  —  GC).  Then  since  both  operators  generate  a 


stable  semigroup,  by  Theorem  3.3.1  their  inverses  exist  and  are  bounded.  Therefore, 
for  complex  numbers  s,  and  s  g  cr{Zk)  C  o{Z)  Vk, 


\\($I  -  Zk)~l  -  {si  -  Z)-'\\  =  \\(sI-Zk)-'[I-(sI-Zk)(sI-Z)-'}\\ 

=  11(5/  -  Zk)-'[{sl  -Z)-  {si  -  Zk)){sl  -  Z)~l\\ 

<  ||(s/ \\zk  -  z\\  11(5/ -Z)-1!! 

<  d  \\Zk-Z\\ 

where  d  is  a  constant.  By  definition  of  Z  and  Zk , 

(Zk  -  Z)  =  {GC  -  GC) 

Thus  one  sees  that 


\\Zk  —  Z\\  =  WGC-GCW 

<  l|G-G||  11^11 

<  d  ||G-G|| 

Therefore,  by  construction  of  G, 

||(5/  -  Z*)-1  -  {si  -  Z)-1||  <  d\\G  -  G|| 

Since  ||G  —  G||  — ♦  0  as  k  — ♦  oo,  then  the  transfer  function  of  the  finite-dimensional 
compensator  converges  to  the  transfer  function  of  the  infinite-dimensional  compen¬ 
sator.  Q.E.D. 

Hence,  by  the  linearity  of  F,  G  and  G  it  has  been  shown  that  lim*_oo  Ck  =  C 
where  in  LQG  notation 

Ck  =  Ke(sl  -{A-  Bl\c  -  KfC))~'k ] 

C  =  F  c  {si  -{A-  BKC  -  KfC))~'K/ 


Recall  that  only  A  j  has  to  be  approximated  in  order  to  satisfy  the  conditions 
needed  in  Theorem  3.2.1. 

Next  one  may  ask  whether  or  not  the  convergence  is  monotone  or  not.  If  the 
convergence  is  monotone,  one  may  be  able  to  select  approximating  eigenfunctions 
that  reduce  the  norm  difference  between  A/  and  its  approximation  the  most.  The 
following  definition  will  be  needed. 


Definition  3.3.1:  A  sequence  {-rn}  C  9?  is  said  to  b e  monotonically  increasing 
if  ^V.+i  >  xn  Vn,  and  is  said  to  be  monotonically  decreasing  if  xn+i  <  xn  Vn. 

THEOREM  3.3.3:  The  finite-dimensional  LQG  compensator  transfer  func¬ 
tion  C\  converges  monotonically  to  the  infinite-dimensional  transfer  function  C  as 
k  — ♦  oc  in  the  sense  that  Y.%k+\  llQijll2  monotonically  decreases  as  k  — *  oc,  (where 
q,j  are  the  coefficients  of  the  eigenfunction  expansion  of  a  function  in  the  range  of 
A/)  if  and  only  if  the  eigenfunctions  xtJ  are  orthonormal,  and  the  series  Q,yx.; 
converges  for  all  i. 

Proof:  Let  {y, }  be  a  basis  for  the  output  space  Y.  By  definition  of  g,, 
A 'jy,  =  g,  =  Q.j-r.j,  where  xtJ  are  the  generalized  eigenfunctions  of  (A  —  BI\C) 
which  are  assumed  complete  (see  discussion  in  Section  3.2)  and  normalized.  qi;  are 
the  Fourier  coefficients  defined  by  the  inner  product  (g,,x,:).  By  construction  of  the 
approximation  of  Kj, 

n, 

KlVi  =  9,  = 

3  =  1 

where  n,  <  k,  the  dimension  of  the  compensator.  Thus 

II A'/y.  -  A'/y.H2  =  ||  Q,jX ,j ||2 

}  =  k+ 1 


v.v;  .v  .v  "«•  v.v  _*  ,« *  s  •  .•  ■ 


From  the  fact  that  xtJ  are  orthonormal.  one  gets  that 

l|A';v.  -  A/y.f  <  £  !|q,j II2 

]  =  k+l 

Since  Qoxo  converges  for  all  i  if  and  only  if  I  Qtj  |2  converges  for  all  i 

(see  [52]  page  308),  and  ||a,j||  is  a  positive  number,  then  this  tail  of  the  sequence  is 
monotonically  decreasing  as  k  — »  oc.  In  other  words, 

Jim  51  |!qu||2  =  0 

In  this  sense  A’/  — +  Kj  monotonically.  Q.E.D. 

Recall  that  A'/  is  approximated  by  using  a  finite  number  of  eigenfunctions 
corresponding  to  a  finite  number  of  eigenvalues.  As  a  minimum,  one  would  want 
to  use  the  eigenfunctions  associated  with  the  unstable  subspace  'Hu  as  a  first  choice 
to  approximate  A'/.  Otherwise,  one  would  not  be  able  to  stablize  the  system  with 
the  lowest  order  compensator  possible.  After  that,  one  could  choose  eigenfunctions 
from  the  subspace  Ti,  based  on  where  one  desires  the  closed-loop  poles  to  lie. 

Figure  3  shows  the  subspaces  and  H,  for  the  case  where  an  infinite  strip 

of  eigenvalues  lies  in  the  left  half  plane.  Obviously,  if  an  infinite  vertical  strip 

of  eigenvalues  is  encountered,  one  cannot  improve  exponential  stability  beyond  it. 

The  approximating  subspaces  are  finite-dimensional  subspaces  of  the  Hilbert  space 

Af,  denoted  by  At*.,  where  k  is  the  dimension  of  the  space.  The  approximating 

subspaces  are  ordered  so  that  At*.  C  Af*,.+  1.  Note  that  Theorem  3.3.3  states  that  the 

approximation  monotonically  converges  with  respect  to  the  tail,  regardless  of  how 

the  approximating  eigenfunctions  are  chosen.  The  question  one  may  now  ask  is,  can 

the  eigenfunctions  be  selected  so  that  the  sequence  is  monotone  in  the  sense  that 

k  k+ 1 

“  HQuxol!  ("0) 

j=i  r=i 

decreases  monotonically  from  k  =  1  on  out.  This  would  allow  one  to  choose  the 
eigenfunctions  associated  with  the  maximum  gain  at  the  start  of  the  design  and 


possibly  get  the  best  controller  for  any  fixed  k.  Clearly  this  means  that,  for  {ju} 
normalized,  one  must  choose  the  “next"  eigenfunction  based  on  the  magnitude  of 
q,  =  (g,.  x,)  for  all  i.  where  g,  =  A/i/,. 

In  general,  q,  has  no  relationship  to  A,  (the  eigenvalue  associated  with  j,)  so 
that  one  cannot  simply  choose  the  “next"  eigenfunction  associated  with  the  “next" 
eigenvalue,  no  matter  how  one  orders  the  A,'s.  What  one  can  do  is  write  the  general 
expression  for  (g,,i,)  and  then  choose  i,  associated  with  supy,(^,,  x,).  Once  this 
j,  is  chosen,  one  can  omit  it  the  next  time  supVl(5,,x,)  is  evaluated.  In  this  way 
one  can  “order"  the  eigenfunction  selection  to  get  monotone  convergence  from  k  = 
1  on  out  (i.e.  q,  >  qi+1  V?  ).  This  would  yield  that  Equation  (70)  is  monotone 
decreasing  as  k  — >  oc. 

Of  greater  importance  is  where  the  resulting  closed-loop  poles  lie,  and  the 
resulting  performance.  If  the  largest  value  of  a,  were  associated  with  a  stable  eigen¬ 
value,  one  might  not  stabilize  the  system  with  the  lowest  possible  order  for  the 
compensator  if  one  were  to  try  and  make  Equation  (70)  monotonicallv  decreasing. 
Thus,  it  seems  one  should  be  concerned  with  choosing  the  eigenfunctions  associated 


with  the  unstable  subspace  7iu.  and  make  sure  that  the  system  is  stabilized  (i.e.. 
shift  at  least  the  unstable  eigenvalues  to  desirable  locations).  The  example  problem 
that  follows  in  Section  3.5  points  out  this  concern. 


3.4  Robustness  Analy*u- 


Schumacher's  approach  yields  a  compensator  that  stabilizes  the  nominal 
system.  The  question  one  needs  to  ask  is  how  robust  is  that  compensator?  What 
type  of  perturbations  can  be  allowed  while  maintaining  exponential  stability? 


Following  the  approach  taken  by  [69],  one  way  to  address  perturbations  is 
to  consider  perturbations  of  the  state-space  operators.  Let  the  nominal  system  on 
which  the  controller  is  based  be  described  by  the  equations 


x  =  ,4.r  +  B 11  x(,  6  I){  .4  , 


y  =  Cx 


and  let  the  perturbed  system  be  described  by 


x  ±  —  ( .4  +  A.4 -f-  (B  -f  A5)u 


y±  =  (C  +  AC)  x& 


First,  consider  the  case  where  perturbations  occur  only  in  the  dynamics  (i.e. 
A B  and  AC  are  both  zero).  In  this  case  the  perturbed  system  will  be  desribed  by 


x±  =  (.4  +  A.4)ja  +  Bu 


V =  Cx, 


For  the  purpose  of  discussion,  the  following  definition  has  been  developed  by 


the  author  of  this  research. 


Definition  3.4.1:  The  system  will  be  dynamically  robust  if  the  system  re¬ 
mains  stable  in  the  presence  of  perturbations  of  the  dynamics. 


For  the  class  of  systems  considered  in  this  research,  the  assumptions  of  de¬ 
tectability  and  stabilizability  yield  that,  for  the  nominal  system,  an  LQG  controller 
will  provide  exponential  stability  of  the  nominal  closed-loop  system.  Also,  the  oper¬ 
ators  A  —  BKC  and  A  —  KjC  both  generate  stable  semigroups  [24].  If  (A  +  AA  —  BKC) 
and  (A  +  A.4  —  A" jC)  also  generate  stable  semigroups,  then  the  system  will  be  dy¬ 


namically  robust  for  that  A.4. 


One  possibility  is  that  A.4  is  a  bounded  perturbation.  In  this  case 


(.4  +  A.4  -  BKC)  =  (.4  -  BKC)  +  AA 


(.4  +  A.4  -  KjC)  =  (A  -  KjC)  -f  A  A 


If  ||  AA  ||  <  j  a'  |,  where  is  the  maximum  of  the  exponential  time  constants 


associated  with  the  semigroups  generated  by  (A  —  BKC)  and  (A  —  A/C).  then  the 
perturbed  closed-loop  system  will  be  exponentially  stable.  This  result  is  given  in 
the  following  lemma. 


LEMMA  3.4.1:  Let  the  system  described  by  Equations  (46)  and  (47)  be 
such  that  (A,f?)  and  (,4,G)  are  stabilizable.  Also,  let  (A.C)  and  (A,Q[J2)  be 
detectable.  Let  A  generate  a  C0  semigroup  and  have  a  discrete  spectrum.  Let 
B  and  C  be  bounded  linear  operators.  Then  the  LQG  regulator  will  stabilze  the 
nominal  closed-loop  system  and  the  closed-loop  system  will  be  dynamically  robust 
to  bounded  perturbations  if  ||  A  A  ||  <  |  w’  |  where  u,’  =  max[u,’i,u>2];  <^i  and  u>2 
are  the  negative  time  constants  associated  with  the  stable  semigroups  generated  by 
(A  —  Bl\c)  and  (A  —  A/C),  respectively. 


Proof:  The  proof  will  be  done  if  it  can  be  shown  that  (A  -f  A  A  —  BI\C) 
and  (A  +  A  A  —  I\j  C )  both  generate  stable  semigroups.  Let  7^(0  and  T/(t)  be 
the  semigroups  generated  by  (A  —  BI\C)  and  (A  —  KjC)  respectively.  Then  the 
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semigroup  !fc(/)  generated  by  (.4  —  BKC)  +  A.4  will  have  the  property  [54]  that 

||  Te(t)  ||<  Jl/,e(u',+l|Ay,|l)‘ 

where  u>i  <  0.  Similarly,  the  semigroup  Tj[t  )  generated  by  (.4  —  A' jC)  +  A.4  will  be 


such  that 


where  a.-2  <  0. 


7/(0  || <  Jl/2c(“*+l|A/4|l)‘ 


Clearly,  if  ||  A.4  ||  <  |  maxpi,-^]  |.  then  both  Tc(t)  and  Tj(t)  will  be  stable 
semigroups,  and  the  closed-loop  system  will  be  exponentially  stable.  Thus,  the 
system  is  dynamically  robust.  Q.E.D. 

From  Lemma  3.4.1  it  becomes  clear  why  the  exponential  time  constant  is  used 
as  a  measure  of  robustness  [19,  21,  23,  58.  59,  60].  However,  this  is  only  true  for 
bounded  perturbations. 

One  may  choose  to  consider  perturbations  to  B  and  C  in  which  case  one  must 
determine  the  stability  of  the  semigroups  generated  by  the  operators  [(4  -f  AA)  — 
( B  +  AB)KC]  and  [(.4  +  A.4)  —  A'/(C  +  AC)]  .  Rearranging  terms,  these  operators 
can  be  written  as  [(.4  -  BKC)  +  ( A.4  -  A2?A'C)]  and  [(.4  —  KjC)  +  (A.4  -  A'/AC)].  If 
(A4  —  ABh'c)  and  (A.4  —  A'/AC)  are  both  bounded,  then  one  can  still  use  Lemma 
3.4.1  as  a  way  of  determining  if  the  system  will  remain  stable  in  the  presence  of 
these  perturbations. 

Another  type  of  perturbation  one  can  consider  is  a  relative  bounded  pertur¬ 
bation.  An  operator  B  is  said  to  be  relatively  bounded  with  respect  to  an  operator 
A  if  D(B)  D  D(A)  and  if  ||Z?x||  <  6||x||  A  a||Ax|j  Vx  €  D{A)  (see  [8]  for  further 
discussion). 
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LEMMA  3.4.2:  Let  A  be  the  generator  of  a  stable  semigroup  T(t)  such  that 
||  T(t)  ||  <  A it'*''  ,u;  <  0.  If  B  is  a  closed  linear  operator  with  D(B)  D  D(A )  and 

||  Bx  ||  <  a  ||  Ax  ||  VxeP(A) 

then  A  -f  B  generates  an  exponentially  stable  semigroup  when  a  <  (M  +  l)-1. 

Proof:  Since  ||  T(t)  ||  <  Me'"'1  <  M ,  then  T(t)  is  uniformly  bounded,  and 

thus  analytic  by  Theorem  2.5.6  of  Pazy  [54].  Theorem  3.2.1  of  Pazy  [54]  provides 
the  desired  result.  Q.E.D. 

Thus,  for  relatively  bounded  perturbations,  a  measure  of  robustness  is  the 
semigroup  gain  factor.  The  smaller  one  can  make  the  constant  M  associated  with 
T(t).  the  larger  the  allowable  perturbations  can  be  and  retain  stability  of  the  closed- 
loop  system.  Lemmas  3.4.1  and  3.4.2  are  not  new  ideas,  but  they  point  out  the 
limitations  of  using  the  exponential  time  constant  as  the  only  measure  of  robustness. 
Also,  Lemma  3.4.2  demonstrates  that  the  gain  factor  can  be  used  as  a  measure  of 
robustness,  a  fact  usually  ignored  by  others. 

3.5  Examplf 

This  example  will  point  out  how  to  apply  Schumacher’s  approach  to 
finite-dimensional  controller  design  to  an  evolution  equation,  and  also  point  out 
how  the  coefficient  a,  associated  with  the  eigenfunction  i,  in  the  eigenfunction  ex¬ 
pansion  is  dependent  on  the  design  parameters  in  the  A.R.E.  of  the  LQG  controller. 
This  example  will  demonstrate  that  it  is  possible  to  have  the  largest  coefficient  a,  be 
associated  with  a  stable  eigenvalue,  and  in  that  case  one  would  not  get  the  “best” 
controller  if  one  were  to  choose  the  eigenfunctions  to  approximate  the  filter  operator 
Ay  based  on  the  monotone  criterion  of  Section  3.3  instead  of  closed-loop  pole  loca¬ 
tion.  In  that  case  one  would  possibly  fail  to  stabilize  the  closed-loop  system  with 
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the  lowest  order  controller,  and  be  led  to  believe  that  a  higher  order  controller  is 
required. 

The  example  problem  is  a  heat  equation  which  describes  the  temperature 
distribution  on  an  isolated  uniform  rod.  The  equation  is  a  parabolic  equation, 
and  the  A  operator  is  such  that  the  nominal  system  is  stable.  The  operators  have 
been  chosen  so  that  solutions  can  be  obtained  in  order  to  make  an  important  point 
concerning  eigenfunction  selection.  Thus,  the  problem  is  not  intended  to  be  an 
accurate  model  of  a  real  system,  but  rather  is  intended  to  be  illustrative. 

Consider  the  problem  given  by 


0  +  +  Iu'(t)  t  >  0;  0  <  z  <  1 

at  7T2  a:2 


(79) 


where  I  is  the  identity  operator,  and  with  Dirichlet  boundary  conditions 


j(0.t)  =  j(l.t)  =  0  Vt  >  0 


(80) 


and  initial  condition 

j(r, 0)  =  0  Vr  £  [0, 1] 

Assume  a  scalar  input  (u  €  3?1)  and  a  scalar  output  given  by 

2/(0  =  /  x(:J)d:  +  »/(<) 

Jo 

with  T](t)  G  S?  Vi  (i.e.  real-valued).  The  state  space  will  be  K  =  L2{0, 1),  and 
choose  the  strengths  of  the  white  Gaussian,  zero-mean  noise  terms  w  and  tj  to  be 
Qo  =  I  and  Rj  =  InTn  respectively.  These  choices  are  made  so  that  the  reader  can 
follow  the  mathematics  of  the  problem  without  confusion,  and  thereby  focus  on  the 
application  of  Schumacher’s  approach.  These  choices  are  also  made  in  order  to  get 
numerical  results  so  that  an  important  point  can  be  made. 

The  domain  of  the  operator  A  is  defined  by 


d2 


D(A)  =  €  K  I  —  X  e  0)  =  r(l)  =  0} 


(81) 
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and  the  operator  A  is  defined  by 


Ax  =  (-2^x  Vi£D(A)  (82) 

■Ki  UZ* 

The  output  mapping  C  is  given  by 

Cx  =  /’  i(z.i)dz  Vx  €  H  (83) 

Jo 

which  can  be  written  in  inner  product  notation  as 

Cx  —  (1.x)  (84) 

which  is  simply  the  inner  product  of  the  function  which  is  ]  everywhere  with  an 
element  of  the  Hilbert  space  TH,  and  is  defined  by  Equation  (83).  Also,  assume  that 
the  output  vector  y  is  to  be  controlled  so  that  the  operator  Qc  will  be  chosen  to  be 
C’C. 

As  shown  in  Schumacher  [59] .  the  operator  A  generates  an  analytic  semigroup 
for  t  >  0.  Furthermore,  A  has  a  discrete  spectrum  with  simple  eigenvalues  at 
—  i2  (i  =  1.2 _ )  with  corresponding  eigenfunctions  given  by 

<t>,  =  %/2sin  inz  (85) 

which  is  a  complete  orthonormal  set  in  L2(0, 1).  Because  of  the  simple  form  of 
B.G,  and  Q0 ,  it  can  be  shown  that  (A,B)  and  (A,G)  are  stabilizable  and  (A,C)  and 
(A ,QlJ2)  are  detectable  [59]. 

One  can  design  a  steady  state  constant  gain  LQ  controller  assuming  full  state 
access  as  shown  in  Matson  [51].  This  yields 

i<c  =  r;'b‘pc  (86) 

Let  Rc  =  Inxn  (for  the  same  reasons  that  Rj  was  chosen  to  be  the  identity  matrix), 
so  that  J\'c  =  Pc  where  Pc  satisfies  the  Riccati  equation 

<  Ah,Pek  >  +  <  Pch,Ak  >  +  <  Qch,k  >  =  <  PcBR~l  B‘  Pch,  k  >  Vfi,  k  e  D{A) 

(87) 
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As  shown  in  Curtain  [24],  Pc  can  be  written  as 


Prh  =  Y  Y  p,j  <  h,  cf>,  >  <t>j 

i=i j=\ 


Also,  one  can  solve  for  the  ptJ' s  by  solving  the  equation  (see  [24]  page  97  for  details) 


(A,  +  Aj)+  <  Qc<p,,Oj  >  =  Yl  Y1  Pit-P.r  <  Rc  'Bm4>k<  B’<t>r  >  (89) 


k=  1  r=l 


Choose  Qc  =  C'C  =  /•  Thus,  substituting  A,  =  1  ,B  =  I,Rt  =  /nrn,  and  Qc  =  / 
yields 

CM  <X 

(-»2  -  ;2)pv+  <  o,,c>j  >  =  EE  P,kp,r  <  <i>k><Pr  >  (90) 


fc=l  T=1 


(-,2 - j2)p>j  + 1  =  YYi^p^  v'  =  j 


and  pu  =  0  when  i  j  because  of  the  orthogonality  of  the  {cf>,}’s.  This  gives  that 
[24] 

(-2>V  +  1  =  pi  (92) 


Using  this  fact  then  yields 


Pch  =  Yp«  <  Po,  >  o,  -  Kch 


In  a  similar  way  one  finds  that  the  steady  state  Kalman  filter  constant  gain 
operator  is  given  by 


Kj  =  PjC’R J1 


where  Pj  satisfies  the  Riccati  equation 


<  A'h,  Pjk  >  +  <  Pjh,  A'k  >  +  <  Qfh,k  >  =  <  PjC’ R]'C P}h,k  > 


where  for  this  problem  A’  =  A  and  Qj  is  given  by 


Qjh  =  GQ0G'h  =  Q0h  V/i  G  H 


For  this  example  Q0  --  I  =  Qj  in  order  to  simplify  the  mathematics.  Also  by- 
duality,  Pj  can  be  written  as 


3 


S5 


psh  -  YY^'j  < h'^' > 

1=1  j=i 


The  q,:'s  can  be  found  from  the  equation 


(A,  +  \j  )qvA  <  QjO, ,Oj  >=E£  ir  <  R ;  ’  C<f>k.C  6r  > 


with  Qj  —  1  and  Rj  =  lnTn  for  the  reasons  mentioned  earlier.  From  the  fact  that 
Ch  =  (\.h)  V/i  £  Pi.  one  can  write 


(A,  +  A_, )(ju  +  dij  =  YY1  <  ('Ok.Cipr  > 


{-I7  -  J2)q,j  +  1  =  Y  Y  (l'k(t'r  <  0k~  °r  >  *  =  J 


(100) 


and  qtJ  =  0  otherwise.  This  gives  the  following  equation  for  q„: 


(~2i7)q„  +  1  =ql 


(101) 


Thus,  the  operator  K j  can  be  written  as 


Rjh  =  Y  (l"  <  ,l- 


(102) 


The  purpose  of  this  example  is  to  illustrate  how  the  approximation  of  l\j  can 
be  affected  by  the  choice  of  the  approximating  eigenfunctions.  One  must  determine 
if  the  eigenfunctions  of  (A  —  Bl\c)  are  complete.  Ah  can  be  written  as  (see  [51]) 


Ah  =  £A,(/i,  <£,}<*>. 


(103) 


where  A,  denotes  the  eigenvalues  of  the  operator  A.  Using  this  expression  for  A 
yields  the  following  expression  for  (A  —  Bl\c): 


{A  -  Bl\c)  =  (A  -  A'c)  =  Y  A,(/t,  -  YP"(h 


(104) 
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which  shows  that  the  eigenvalues  are  shifted  by  (A,  —  p„)  for  all  i,  and  the  eigen¬ 
functions  will  be  the  same  (and  therefore  complete). 


Using  the  quadratic  formula,  one  can  solve  for  p„  and  qu  as  given  by 

— 2;2  v/(-2>2)2  +  4 


Pa  =  q„  = 


+ 


(105) 


which  for  this  example  gives 


Vn  =  .41  =  p,, 
<?22  =  .12  =  p22 


(J33  —  -0()  —  P33 

and  so  forth.  The  resulting  regulator  poles  will  be  the  spectrum  of  the  operator 
(.4  —  Bh\.)  which  is  given  by 

a(A-  BJ<e)  =  \,-q„  1  =  1,2....  (106) 


and  the  filter  poles  will  be  the  spectrum  of  the  operator  (.4  —  l\jC)  which  is  given 
by 

(t(A  -  K/C)  =  A,  —  p„  1  =  1.2 _  (107) 

The  amount  of  spectrum  shift  that  occurs  is  a  function  of  the  operators  A'c  and  I\j , 
which  are  determined  by  the  A.R.E.s  and  therefore  are  a  function  of  the  operators 
Rf,Rc,Qj,Qc,C,B,  and  Cj.  Let  the  order  of  the  approximating  subspace  be  k  =  2 
and  select  the  finite-dimensional  subspace  associated  with  <£1  =  \/2sinm.  This  will 
give  the  following  approximation  for  the  operator  A’/ 

1 

=  (108) 
1=1 


and  as  a  result  of  restricting  the  domain  of  A'c,  it  can  be  expressed  as: 


The  resulting  regulator  poles  will  be  given  by  a(A  —  BI\C )  which  is 

% 

I 

Pi  =  A,  -  qn  =  -1  -  .41  =  -1.41  ! 

//,  =  A,  i  =  2,3 -  < 

Since  for  this  problem  />,,  =  q„>  then  the  filter  will  have  the  same  poles. 

If  the  operators  /?/  and/or  Q j  were  chosen  differently,  the  values  of  q„  could  1 

be  changed  so  that  they  are  not  monotone  decreasing.  For  instance,  let  Qj  be  such 
that  it  acts  like  the  identity  operator  except  for  when  it  maps  <j>\.  For  that  case 
let  Q /  ■  <P\  (.l)0i.  Then  one  finds  that  qn  equals  .041  and  is  less  than  q2 2- 

Then  if  one  choses  <j>2  as  the  approximating  eigenfunction  because  it  has  the  largest 
coefficient  associated  with  it.  the  eigenvalue  at  0  is  not  shifted  and  the  system  will 

not  be  stable.  Thus,  choosing  the  eigenfunctions  in  order  to  get  a  monotone  sequence  J 

from  k  =  1  on  out  may  not  be  the  best  thing  to  do.  It  is  more  important  to  choose  | 

the  approximating  eigenfunctions  based  on  where  the  resulting  closed-loop  poles  lie. 

Since  the  total  closed-loop  poles  are  the  poles  of  the  regulator  and  the  poles  of 
the  filter,  exponential  stability  may  or  may  not  be  affected  by  approximating  K j.  If 
one  had  chosen  the  noise  strengths  differently,  the  filter  and  regulator  may  not  have 
had  the  same  poles.  In  that  case,  one  might  have  chosen  a  different  approximation 
for  Kj  such  that  the  pole  of  the  regulator  closest  to  the  right-half  plane  was  not 
affected.  The  system  stability  would  then  be  determined  by  the  regulator,  and  ( 

unaffected  by  the  approximation  of  l\j.  Matson  [51 )  gave  an  example  for  which  the 
system  stability  is  determined  by  the  regulator.  The  question  one  now  has  fo  be 
concerned  with  is,  how  robust  is  the  finite-dimensional  controller? 

3.6  Summary 

This  chapter  has  shown  that  the  LQG  compensator  obtained  by  ap¬ 
plying  the  control  theory  of  Chapter  2,  satisfies  the  conditions  established  by  Schu¬ 
macher  (see  Theorem  3.2.2)  when  it  is  assumed  that  the  eigenfunctions  of  {A  —  Bl\c) 
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are  complete.  As  discussed  in  Section  3.2.  this  assumption  can  be  satisfied  if  I\c 
is  chosen  properly  during  the  LQG  design.  Thus,  it  appears  that  this  is  not  a 
restrictive  assumption. 

Section  3.3  proves  that  the  finite-dimensional  controller  obtained  using  Schu¬ 
macher’s  approach  converges  to  the  desired  infinite-dimensional  LQG  controller  as 
the  dimension  of  the  controller  increases.  This  proof  was  not  found  in  Schumacher’s 
work,  and  is  provided  in  this  research  for  completeness.  Section  3.4  analyzes  the 
robustness  of  the  finite-dimensional  controller.  It  is  shown  that  only  a  limited  anal¬ 
ysis  is  possible  after  the  controller  lias  been  designed.  As  a  result.  Chapters  5  - 
7  develop  additional  robustness  techniques  that  can  either  be  used  in  conjunction 
with  Schumacher's  approach,  or  can  be  used  as  a  basis  for  a  different  approach  to 
finite-dimensional  controller  design. 

Section  3.5  provides  a  simple  example  to  illustrate  the  application  of  Schu¬ 
macher's  approach.  It  is  pointed  out  that  one  must  be  concerned  with  the  resulting 
location  of  the  closed-loop  poles,  as  opposed  to  selecting  eigenfunctions  so  that 
monotone  convergence  occurs. 

The  next  chapter  presents  a  sufficient  condition  that  allows  the  LQG/LTR 
technique  to  be  extended  to  the  class  of  problems  considered  in  this  research.  The 
approach  taken  is  different  from  the  one  taken  by  Matson  in  his  work  [51].  However, 
the  sufficient  condition  may  not  be  satisfied  by  the  entire  class  of  problems  considered 
in  this  research.  As  an  alternative,  an  approximation  of  the  LQG/LTR  technique  is 
presented  based  on  the  work  by  Banks  [7],  The  LQG/LTR  technique  allows  one  to 
achieve  robustness  by  adjusting  the  defining  A.R.E.s,  and  therefore  could  be  used 
in  conjunction  with  Schumacher’s  approach. 
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IV.  LQG/LTR  Extension 


4-1  Introduction 


This  chapter  will  consider  the  LQG/LTR  technique  for  robustness  en¬ 
hancement.  As  developed  by  Doyle  and  Stein  [30]  the  technique  involves  adding 
a  pseudonoise  term  02B\  B'  to  the  operator  Q /  in  the  filter  A.R.E.,  and  tuning 
the  equation  so  as  to  recover,  asymptotically,  the  loop  transfer  function  of  the  LQ 
regulator.  The  technique  was  extended  to  a  class  of  DPS  by  Matson  [51],  but  not 
to  the  entire  class  of  systems  considered  in  this  research.  Specifically,  Matson  ex¬ 
tended  the  technique  to  those  problems  for  which  A’  is  bounded  (which  includes 
finite-dimensional  problems),  and  those  problems  where  R(B)  U  R{Q  j)  is  contained 
in  a  finite-dimensional  space  spanned  by  a  finite  number  of  eigenfunctions  of  A *  (see 
[51]  Lemma  4.11). 

Consider  the  class  of  problems  described  in  Section  3  of  Chapter  1,  with  the 
added  assumption  that  the  number  of  inputs  equals  the  number  of  outputs.  The 
steady  state  Kalman  filter  constant  gain  operator  Kj  is  given  by 


i\t  =  PrC-R-;' 


(110) 


where  the  covariance  operator  Pj  is  the  unique  positive  self-adjoint  solution  to  the 
following  A.R.E.: 


(Pfh,  A’k)  +  (A’h,  Pjk)  +  (Qfh,k)  =  (P}Cm R]'CPfh,  k) 


(111) 


for  all  h,k  £  D(Am ),  under  the  standard  assumption  that  ( A,G )  is  stabilizable  and 
(A,C)  is  detectable.  Also,  note  that  Qj  ~  GQ0Gm,  where  Q0  is  the  positive  semi- 
definite  operator  that  describes  the  strength  of  the  dynamics  driving  noise  w  (see 
Equation  (1)). 

The  LQG/LTR  technique  modifies  the  noise  term  so  that  Qj  =  Q /0  +  BV B' 
where  Qj0  is  the  nominal  value  of  Qj  that  provides  the  best  filter  tuning  at  design 


conditions,  0  is  a  positive  scalar,  B  is  the  system  input  operator,  and  V  is  any  N  by 
N  positive  definite  matrix.  This  then  yields  a  family  of  Kalman  filter  gain  operators 
Kf0  which  are  given  by 

KJP  =  PfiC'R?  (112) 

and  P0  is  the  solution  of  the  algebraic  Riccati  equation 

(P0h,A'k)  +  (A’h,  P0k)  +  {(<?,+  02BVB'h,k)  =  {P0C‘ R]'CP0h,  k)  (113) 

This  A.R.E.  can  be  written  in  terms  of  the  operator  Y0  by  setting  Y0  =  This 

yields 

(Y0h,  A‘k)  +  (Amh,Y0k)  +  ((BVBm  +  0~2Qf)h,k)  =  02  (Y0C‘  R~f'CY0h,  k)  (114) 
for  all  h,k  e  D(A'). 

The  objective  of  the  LQG/LTR  technique  is  to  increase  the  scalar  0  (and  thus 
the  noise  term  Qj)  so  that  the  following  limit  exists: 

]\mKJ0\l  +  C(sI-A)-'K,iJ]-lr  =  B[C(sl-A)-1B]-lr  Vr  G  Cs  (115) 

P  —  OG 

If  this  limit  exists,  then  one  is  able  to  recover  the  loop  transfer  function  associ¬ 
ated  with  the  LQ  regulator  at  the  input  to  the  plant  (or  by  using  the  dual  procedure 
of  Kwakernaak  and  Sivan  [49],  one  can  recover  the  loop  transfer  function  associated 
with  the  Kalman  filter  at  the  output  of  the  plant).  Matson  proved  that  a  sufficient 
condition  for  this  limit  to  exist  is  if 

07Y0C-R]lCY0  ^  BVBm  as  0  -  oo  (116) 

§ 

where  — >  denotes  strong  convergence.  A  sequence  of  bounded  linear  operators  K0  is 
said  to  converge  strongly  to  a  bounded  linear  operator  K  if  lim^_oc  ||(A'^  —  I\)h  ||  = 
0  for  each  h  in  the  normed  linear  space  on  which  K  is  defined.  Other  types  of 
convergence  include  weak  and  uniform  (see  [64]  for  a  discussion  of  these). 


This  chapter  will  look  at  conditions  under  which  this  strong  convergence  ex¬ 
ists.  Section  4.2  provides  one  set  of  sufficient  conditions.  Section  4.3  explains  why 
many  authors  have  not  worried  about  strong  convergence,  and  then  a  second  set  of 
sufficient  conditions  is  provided.  Since  niether  of  the  sufficient  conditions  developed 
in  this  chapter  are  physically  motivated,  Section  4  considers  how  to  approximate 
the  LQG/LTR  technique  using  the  approach  developed  by  Banks  [7]. 

4-2  Sufficient  Condition 

The  following  theorem  gives  a  sufficient  condition  for  the  results  of 
Matson  [51]  to  be  valid  for  the  class  of  systems  considered  in  this  research. 

THEOREM  4.2.1:  Let  H  be  a  real  Hilbert  space  and  Yg  6  C{'H)  be  the 
unique,  positive,  self-adjoint  solution  to  the  algebraic  Riccati  equation 

(Yph,  A’k)  +  (A*h,  Ypk)  +  ((BVBm  +  0~2Qj)h,k)  =  /32{YpCmR]'CYph,k) 

for  all  h,k  £  D(A’)  where  A,  B,Q /,C,  and  Rj  are  as  described  in  Section  3  of 
Chapter  1.  Let  V  be  a  positive  definite  N  by  N  matrix,  and  let  /?  be  a  scalar  >  0. 
Also,  assume  that  the  number  of  inputs  equals  the  number  of  outputs.  Then, 

lim  f)2(YpC* R~flCYph,  k )  =  ( BVB-h ,  k }  VA,  k  €  D{A') 

P—oo  1 

implies  that 

p2YpCmR]'CY0  4  BVB’  as  oo 

if  the  operator 

Kg  =  {BVB-  +  0-2Q}  -  P2YgC-R]'CYg) 

is  uniformly  bounded  (in  the  operator  norm)  independent  of  ft,  for  ft  sufficiently 
large,  and  if  Kg  is  positive  semi-definite  for  /?  large. 

The  difficulty  with  this  theorem  is  that,  the  conditions  on  Kg  are  not  physically 
motivated.  There  is  not  a  known  class  of  systems  which  satisfy  these  conditions  by 


the  nature  of  their  state  space  operators.  To  use  this  theorem  requires  one  to  confirm 
the  conditions  on  a  problem  by  problem  basis.  However,  it  is  this  author’s  opinion 
that  the  conditions  will  be  satisfied  for  a  large  class  of  problems.  The  boundedness 
assumption  on  Kp  is  reasonable  because  the  operator  Yp  is  bounded  independent  of 
0.  Thus,  Kp  appears  to  be  uniformly  bounded  as  well.  The  proof  of  the  theorem  is 
now  presented. 


Proof:  Since  the  system  is  assumed  to  be  stabilizabie  and  detectable,  then 
as  shown  in  Jacobson  [47]  and  Curtain  [19],  this  implies  that  the  system  operator 
A  satisfies  the  spectrum  decomposition  assumption  and  has  finitely  many  unstable 
eigenvalues  of  finite  multiplicity.  Let  be  the  subspace  spanned  by  the  eigenfunc¬ 
tions  corresponding  to  the  unstable  eigenvalues,  and  H,  be  the  subspace  spanned 
by  the  eigenfunctions  corresponding  to  the  stable  eigenvalues.  Then  as  shown  in 
Schumacher  [59],  one  can  write  H  =  ©  H,  and  as  such  one  can  decompose  the 

system  operators  as  follows: 


A  = 


A,  0 
0  Au 


Qj 


Qs.  0 

0  Qju 


B  = 


B. 

Bu 

C=[C.  Cu] 


and  for  any  h  €  'H  one  can  write  h  =  h,  ©  hu  where  h,  €  H,  and  hu  €  Hu.  Now,  by 
this  construction  one  can  also  decompose  Yp  as 


Yp.  0 

0  Ypu 


In  this  way  one  can  write  the  algebraic  Riccati  equation  (A.R.E.)  in  two  parts, 
corresponding  to  the  stable  and  unstable  subspace  restrictions.  Note  that  since  Hu 


is  finite  dimensional,  the  corresponding  A.R.E.  is  a  finite  dimensional  equation  and 
thus,  by  Lemma  4.11  in  Matson  [51], 

02Y0uC:R^CuYOu  4  BUVB : 

Thus,  one  needs  only  to  show  that  this  convergence  holds  for  the  A.R.E.  correspond¬ 
ing  to  the  stable  subspace  restriction.  In  other  words,  one  needs  to  show  that 

i32y0,c;r]1c.y0,  A  b,vb: 

Now.  as  shown  in  Curtain  and  Gibson  [38,  24],  one  can  write  Y0h  as 

Ysh  =  jT  T'{s)(BVB *  +  0-2Qf  -  (32Y0C'R]'CY0)T(s)hds  V/t  £  H 

where  T(t)  is  the  stable  semigroup  generated  by  ,4a.  This  is  a  different  formulation 
from  the  one  used  by  Matson  [51]  who  used  the  identity 

(x0.  =  min {J^  [(x(s),  ( BVB‘  +  (3~2Qj)x(s ))  +  /?"2(u(s),  Rju{s))]ds} 

Also.  Matson  used  the  semigroup  generated  by  the  operator  A  instead  of  the 
semigroup  generated  by  the  operator  As.  The  expression  for  Y0  used  in  this  theorem 
yields  the  following  inner  product  equation 

(Yph,  k)  =  (jH  T’(s)K0T{s)hds,k)  Vh,k  €  W 

where  I<3  =  ( BVB *  +  0~2Qj  -  02Y0C‘R]lCY0). 

By  continuity  of  the  inner  product,  Curtain  (see  [24]  page  93)  shows  that  one 
can  write 

(Ysh,  k)  =  (J™  T-(s)K0T(s)hds,k) 

=  f°°  (K0T(s)h,T(s)k)ds 
Jo 

Now  Matson  [51]  has  shown  that,  for  the  case  where  the  number  of  inputs 
equals  the  number  of  outputs,  and  under  the  assumptions  of  this  development, 


so  that,  from  the  previous  equality, 


lim  (  [°°  T'(s)K0T(s)h,k)ds  =  0  Vh,ke?i 

P—oo  Jo 

Next,  it  will  be  shown  that  for  K0  positive  semi- definite, 

roo  roo  roc 

Jo  \\I<0T(s)h\\2ds  <  {jf  ( K0T(s)h,T(s)h)ds}{Jo  ( K20T(s)h,K0T(s)h )} 

This  will  be  needed  in  order  to  show  that  lim^oo/o00  ||A'^7’(s)/i|[2<fs  =  0.  Let 
f(s)  =  T(s)h ,  and  define  a  pseudonorm  on  f(s)  as: 

in /hi  =  i/./r 

where  [/,  y]  =  (K0f(s),y(s))ds.  A  pseudonorm  differs  from  a  norm  only  in  that 

||]  / HI  can  be  zero  for  /  ^  0.  Since  K0  is  positive  semi-definite,  and  not  strictly 
positive,  this  can  occur.  Note  that  since  1\0  >  0,  then  [/,  /]  >0  V/.  Thus,  for 

any  6,  t  £  and  /  and  z  in  'H , 

o  <  III  6f  +  <--|||! 


which  implies 

0<62|||  /HI  +  26c[f, z]  -f  <2|||  z|||2 
For  [/. z]  ±  0.  let  e  =  ||^||  to  yield 

0<#\\\  /III2  +  26  |  [f,z]  |  +|||  ;:|||2 


Now  let  6  =  j I ^  •  This  then  implies  that: 


This  implies  that 


0  <  _  ElZdl  + 

"  ITT  hi  / in2 

I  [/,*]!<  Ill  /III  IIM 


Letting  /(s)  =  T{s)h  and  z(s)  =  K0T(s)h,  from  the  last  inequality  one  gets  that 

roo  roo  roo 

l  \\K0T(s)h\\2ds  <  {Jo  (K0T(s)h,T(s)h)ds}{Jo  (K20T(s)h,  K0T(s)h)} 


Now,  it  can  be  shown  that  if  K0  >  0  and  if 


lim  (  f°°  T’(s)K0T(s)h>k)ds  =  0 

0—oc  Jo 

then,  when  K0  is  uniformly  bounded  independent  of  0 ,  one  gets  that: 

lim  [°°  \\K0T(s)h\\2ds  =  O 

p—o c  Jo 

It  was  shown  that 

J°°  \\K0T(s)h\\2ds  <  {  J~(K0T(s)h,T(s)h)ds}{  jT (K2T(s)h,  KpT(s)h)} 

However , 

1°°  (KpT(s)h,  KpT(s)h)ds  <  ||  A>||3||7'(s)||2||/i||2ds 

Jo  Jo 

which  yields 

r{K20T(s)h,KgT(s)h)ds  <  fc3||ft|i2  r  ||r(s)||2ds  =  D  <  oc 
Jo  Jo 

where  ||A'^||  <  k.  Thus,  the  integral  is  bounded  independent  of  0.  Since 

lim  {  I"  T‘(s)K0T(s)h,  k)ds  =  0 

0— OC  Jo 

Then 

roc  roc  roc 

l  \\K0T(s)h\\2ds  <  {Jo  { K0T(s)h,T(s)h)ds}{Jo  (h’2T(s)h,  K0T(s)h)} 

yields  the  result  that 

lim  r  \\K0T{s)h\\2ds  =  0 

0— OC  Jo 

With  this  last  result,  and  using  the  fact  that  K0  is  uniformly  bounded  inde¬ 
pendent  of  0  (which  is  not  integer  valued)  for  0  sufficiently  large,  it  can  now  be 
shown  that: 

lim  ||A>A||  =  0 
0—00 
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for  all  h  €  W,  which  is  the  desired  convergence  result.  For  any  t  >  0,  one  gets  that 

|  IIAVXOM!’  -  llA'oAII3  1=1  £  | 

=  2  |  [’ (KpAh,  KpT(s)h)d>  | 

Jo 

<2[J‘\\K0Ah\\2ds}^[J‘  ||A>F(s)/i||2ds]1/2 
=  2t'*\\K,Ah\\[£  \\K0T(s)h\\2dsY <2 
<2t''Hlh[fQ  \\K0T(s)h  l^ds]1^2 
<2t1/3Alk[J~  \\K0T{s)h\\2ds]1'2 

Since  K0  is  uniformly  bounded,  then  \\K0Ah\\  <  Mh ■  Now,  choose  t  =  t0 

where 

Notice  that  t0  — *  oo  as  0  — *  oc.  Also,  substituting  this  choice  of  t  =  t0  into  the 
inequality 

I  HAW!)*!!2  -  l|A'„*i|2  |  <  2ill7Mh\ jH  l|A«r(«)'i|l2<Js]'/! 

yields 

f  OO 

I  WKfTMhf  -  ||A-„A||2  |  <  2A/,[ jf  HKpTU)hfds)'>< 

This  last  inequality  implies  that 

r  oc 

HAWAII2  <  l|A'er((„)ft||!  +  2 M,[jf  ||A<,7»A||2<fe]1/'' 

But  since 

\\KpT(te)h\\  <  ||A'a||||r(is)||||/,|| 

<  ||A„||Me"-||f,|| 


where  D  is  a  constant  depending  on  the  bound  of  I\p  and  the  semigroup  constant 
M.  Since  u?  <  0  (T(t)  is  a  stable  semigroup  generated  by  At)  and  tp  — ♦  oo  as 
0  — >  oo,  then 

—  0  as  0  oo 

This  then  yields  from  the  inequality  for  1 1  A' ^ /i | j 2  that 
tjA'^U-O  as  0  —*  oo  VheH 

since  it  was  established  that  /0°°  ||A'0T(.s)/>  j|2ds  as  0  — *  oo.  Thus,  the  desired  con¬ 
vergence  has  been  proven  for  Kp  being  uniformly  bounded  independent  of  0 ,  and 
for  l\p  positive  semi-definite.  Q.E.D. 

Since  strong  convergence  is  a  sufficient  condition  for  the  LQG/LTR  technique 
to  be  valid,  then  Theorem  4.2.1  gives  a  sufficient  condition  for  the  technique  in 
terms  of  the  operator  Kp.  Since  Yp  is  bounded  independent  of  0,  it  is  reasonable  to 
assume  that  Kp  is  also.  Therefore,  the  only  restrictive  assumption  would  appear  to 
be  the  assumption  that  Kp  is  positive  semi- definite.  Theorem  4.2.1  took  a  different 
approach  than  that  found  in  Matson  [51],  and  therefore  may  yield  insights  not 
before  available  that  may  allow  the  LQG/LTR  to  be  extended  to  the  entire  class  of 
problems  considered  in  this  research  (see  Chapter  1,  Section  3).  The  next  section 
discusses  why  many  authors  have  not  been  concerned  with  strong  convergence  (and 
thus  have  ignored  the  issue),  and  also  provides  another  sufficient  condition  for  strong 
convergence. 

4-3  Conditions  for  Strong  Convergence 

This  section  will  consider  why  it  is  difficult  to  prove  strong  convergence 
exists,  and  why  many  authors  have  avoided  the  issue  when  dealing  with  algebraic 
Riccati  equations  on  infinite- dimensional  spaces.  The  results  of  Lukes  and  Russell 
[50]  will  be  applied  to  demonstrate  that  the  A.R.E.  of  Theorem  4.2.1  has  a  bounded 
extension  to  the  entire  Hilbert  space  W,  which  is  why  most  authors  have  considered 


the  A.R.E.  to  be  defined  on  the  entire  Hilbert  space.  A  bounded  extension  Be  is  a 
bounded  linear  operator  that  equals  an  operator  E,  the  operator  to  be  extended,  on 
£>(E),  and  which  is  defined  on  the  entire  Hilbert  space  Ti  containing  Z)(E). 

The  difficulty  in  proving  that  strong  convergence  exists,  is  the  fact  that  the 
algebraic  Riccati  equation  (A.R.E.)  is  only  defined  on  D(A*).  The  equation  has 
been  considered  by  many  to  be  defined  on  the  entire  Hilbert  space  H  because  of  the 
following  lemma  from  Lukes  and  Russell  [50], 

LEMMA  4.3.1:  The  operator  (YgA°  +  AYg)  associated  with  the  A.R.E.  given 
by 

<  O'*. 4’  +  AYa)h.k  >  +  <  BV B'h,  k  >  +  <  0~2Qfh,k> 

=  02  <  YgCmR]'CYgh,k  >  Vh,k  e  D(A’) 

has  a  bounded  linear  extension  to  all  of  'H.  for  each  0. 

Proof:  (see  Lukes  and  Russell  [50]).  From  Theorem  4.3.1,  for  h,k  6  D(A’), 
one  has  that 

<  A‘h,  Ygk  >  +  <  Ygh,  A‘k  >  =<  Bth,  k  > 

where  B0  is  a  bounded  linear  operator  defined  on  all  of  W,  and 
Be  =  32Y0Cm Rj1  CY0  —  ( BVB"  +  Qj/02).  Since  Be  is  defined  on  all  of  H ,  then  it 
is  true  that  {YgAm  +  A>*)  has  a  bounded  extension  equal  to  Be  on  all  of  H  for  each 
0.  One  should  note  that  Be  is  dependent  on  0 ,  so  that  there  is  not  necessarily  a  Be 
that  satisfies  the  A.R.E.  of  Theorem  4.3.1  for  all  0.  Q.E.D. 

It  is  not  known  whether  or  not  one  can  show  that  Be  of  Lemma  4.3.1  is 
uniformly  bounded  for  all  0.  If  one  could  show  that  to  be  true,  then  Kg  of  Theorem 
4.2.1  would  be  uniformly  bounded.  Another  useful  insight  comes  from  Gibson  [38], 
who  demonstrates  that  Yg  maps  D(Am)  onto  D(A).  This  fact  allows  one  to  write 


<  Y0h,A’k  >  as  <  AY0h,k  >  so  that  the  A.R.E.  can  be  written  as 

<  YpA’h ,  k  >  +  <  AY0h,  k  >  +  <  it  >  +  <  Qj/02h,  k  > 

=  02  <Y0C'R]'CY0h,k  >  Vh,keD(Am)  (117) 

and  the  strong  convergence  of  Y0  to  0  [51],  for  the  class  of  systems  in  Theorem  4.2.1 , 
yields 

lim  02  <  Y0CmR]lCY0h,k  >  =  <  B\’Bmh,k  >  Vh,k  e  D(A')  (118) 

Therefore,  the  question  one  needs  to  ask  is,  when  does  (32Y0Cm R~j'  CY0  — *  BV B' 
strongly  as  0  —*  oo?  The  following  lemma  gives  a  sufficient  condition  for  this  to 
happen. 

LEMMA  4.3.2:  For  the  assumptions  of  Theorem  4.2.1 ,  if  (07YpCm  R~jlCYph,  h) 
is  a  monotone  (either  increasing  or  decreasing)  sequence  for  increasing  0  (see  Defi¬ 
nition  3.3.1),  then 

02YgCm FTj'CYp  4  BVB’ 

where  convergence  is  strong. 

Proof:  Only  the  case  of  02YpC’ RjlCYp  being  monotonically  increasing  will 
be  considered.  If  02YpCmR^CY0  is  monotonically  increasing,  then,  since  the  limit  of 
Equation  (118)  exists,  it  must  be  true  that  [BVBm  -  02Y0C’Rj1CY0\  is  positive  V/? 
and  V/i  €  D(A').  Then  Theorem  3.6  in  [48],  page  453,  yields  that  02Y0C*RjlCY0  — + 
BVB‘,  with  convergence  being  strong.  A  similar  result  applies  if  02Y0Cm Rj1  CY0 
is  monotonically  decreasing.  In  that  case  the  operator  [02Y0C’ RjlCY0  -  BV B* ]  is 
positive,  and  again  [48]  yields  that  strong  convergence  exists.  Q.E.D. 

It  is  not  known  whether  or  not  this  sufficient  condition  can  be  demonstrated 
for  the  entire  class  of  systems  described  in  Section  3  of  Chapter  1.  However,  it  is 


believed  that  it  will  occur  in  many  problems.  As  a  designer,  one  must  evaluate 
P7)pCm  Rj1  CYp  on  a  problem  by  problem  basis  to  determine  if  it  is  monotone,  to 
see  if  the  LQG/LTR  technique  can  be  used  confidently.  This  may  not  be  easy  to 
do.  Even  if  the  operator  is  not  monotone,  the  LQG/LTR  technique  may  still  work 
since  this  is  only  a  sufficient  condition.  The  next  lemma  gives  one  sufficient  design 
condition  for  &7YpCm  R'^  CYp  to  be  monotone.  In  the  lemma,  V  and  Rj  will  be 
chosen  to  be  identity  operators.  These  choices  are  made  to  simplify  the  details  of 
the  proof,  which  only  requires  that  V  and  Rj  be  as  described  in  Section  4.2.  Other 
assumptions  needed  in  the  next  lemma  are  that  the  inputs  u  be  elements  of  Z,2  space, 
and  that  the  state  variable  j  be  bounded  away  from  zero.  The  assumption  on  u  is 
not  very  restrictive  for  real  problems.  The  assumption  on  x  implies  that  the  system 
has  stochastic  controllability  so  that  x  can  be  bounded  away  from  zero  by  adding 
white  noise.  Two  additional  assumptions  involve  the  operators  B *  and  C.  These 
assumptions  do  not  have  a  physical  significance,  but  rather  are  chosen  in  order  to 
make  the  proof  work. 


LEMMA  4.3.3:  Make  the  assumptions  made  in  Theorem  4.2.1  (except  for 
the  ones  for  Kp).  Let  Qj  be  a  bounded  positive  linear  operator  with  a  bounded 
square  root  Qj  ,  and  let  the  positive  definite  matrix  V  =  I  ,  let  Rj  =  I  ,  and  let 

r  II  u(s)  II2  ds  <  M  Vu€U 
Jo 


/  ||  x(s)  ||2  ds  >  e  >  0  Vx  €  H 

Jo 

and  let  B"  be  such  that  its  inverse  exists  (not  necessarily  typical  of  physical  prob¬ 
lems)  so  that 

r  II  B-x{s)  II2  ds>k  r  II  *(*)  IIs  ds  ,  k  >  0 
Jo  Jo 

Finally,  let  C  be  a  unitary  operator.  Then  under  these  conditions, 


pYpC-R-.'CYp 


is  monotone  increasing. 


Proof:  Since  Yp  satisfies  the  A.R.E.,  then  it  can  be  expressed  [24]  as 

<x0,Ypx0>  =  min  /  [<  x(s),  6x(s)  >  +  0~' <  t i(s),  Rju(s)  >}ds 

u  Jo 

where  x0  €  "H  and  6  =  BB’  +  Qj/0'.  This  then  yields 

too 

<xo,0Ypxo>  =  min  /  [<  x(s),  0Ox{s)  >  +  0~l  <  u(s),  R/u{s)  >}ds 

As  demonstrated  by  [24],  the  minimum  is  attained  with  u  =  —Kjx.  Let  u‘ 
and  x*  be  the  solutions  obtained  by  performing  the  minimization.  Then  one  gets 

<xo,0YpXo>  =  /  [<  xm,06x’  >  +  0~'  <  um ,  R jum  >}ds 

Jo 

Substituting  for  0  then  gives 

<xo,0)'pxo>  =  /  [<  x’,0BB‘xm  >  +  1/0  <  x',Qfxm  >  + 

Jo 

1/0  <  um ,  Rju *  >]c/s 


which  is  equivalent  to 


<xo,0Ypxo>  =  r  0  II  Bm 

Jo 


x*  ||2  ds  4-  1 


l&  J£  II  Q)12*'  iij  *  + 

UI)J/°\\R)nx-tfds 


Define  this  inner  product  as  H{0)  =<  xo,0Ypxo  >.  This  inner  product  will  be  an 
increasing  function  of  0  if  its  derivative  H'{0)  is  positive,  which  occurs  if 

H'[0)  =  1°°  ||  £*x*  ||2  ds  -  1/0'J~  ||  Q),2x‘  ||2  ds  -  l/02Jo°°  ||  R)/2x *  ]|2  ds 

is  positive.  The  fact  that  Q/  is  a  bounded  operator  and  the  assumptions  of  the 
lemma  yield 


»'W  >  K  jf  II  x-  II1  is  -  £  /”  ||  x-  ||!  *  -  j,  £ ”  ||  x‘  II1  i. 


M  r00 
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«'V»  >  K‘  -  ff  -  Ji 


H\0)  >  Ke  - 


Ke  +  M 


32 


which,  for  0  sufficiently  large,  is  positive  Vx0  £  H.  Now,  since  0Y0  is  self-adjoint, 
then  it  is  also  normal  (i.e.  0Y00Y0  =  0Y0  0Y0  ).  This  yields  that  the  sqaure  root  is 
normal  [41].  Then  by  Theorem  5.23.15  in  [52], 


»''Xn**f  =  ||W,*„||  =  w^'X'7)2** 


Thus,  if  <  xo,0Y0xo  >  increases  as  0  increases  (which  is  proven  in  [51]),  then 
||  0x/2Y0l2xo  ||2  increases,  as  does  ||  0Y0xo  ||2.  This  gives  that  <  0Y0xo,  0Y0xo  >  is 
a  monotonically  increasing  function  for  0  sufficiently  large. 

Now,  let  C  be  a  unitary  operator.  Then  for  Rj  =  /, 

<  02Y0C’R]xCY0xo,xo  >  =  <  R]'/2C0Y0xo,R-f'/2C0Y0xo  > 

=  <  C0Y0xo,C0Y0xo  > 

=  <  C'C0Y0xo,  0Y0xo  > 

—  <  0Y0xo,  3Y0xo  > 

so  that  for  0  sufficiently  large,  02Y0C'RjlCY0  is  a  monotonically  increasing  oper¬ 
ator.  Q.E.D. 


The  problem  with  Lemma  4.3.3  is  that  the  conditions  are  not  physically  moti¬ 
vated.  In  the  case  where  the  input  space  is  finite-dimensional,  ||  /?J1/2u(s)  ||  will  be 
bounded  and  stochastic  controllability  would  imply  that  the  states  can  be  bounded 
away  from  zero  by  adding  white  noise.  However,  one  cannot  usually  expect  to  satisfy 
the  condition 

roc  f  oo 

/  ||  B-x(s)  ||2  ds  >  k  ||x(s)||2ds  (119) 
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or  to  have  the  operator  C  be  a  unitary  operator.  The  lemma  does  give  some  added 
insight  into  how  to  approach  showing  that  32YgC‘R'jlCYp  is  a  monotonically  in¬ 
creasing  operator  for  other  classes  of  problems.  For  example,  it  may  be  possible  to 
show  that,  for  certain  problems, 

||  Q)n x-  ||!  ds  +  /”  ||  R'/2x-  P  is 
||  B- 1(5)  |P  ds 

i.e.,  it  is  uniformly  bounded  Vx  and  u.  This  would  result  in  //'(/?)  being  positive, 
so  that  (using  a  proof  similar  to  that  of  Lemma  4.3.3)  one  can  show  there  exists 
a  3  such  that  <  ^y^x0,^}^x0  >  is  monotone.  Also,  it  may  be  possible  to  prove 
that  <  C  3Ygx0,C  3Ygx0  >  is  monotone  for  arbitrary  C  E  £(H;9?V),  given  that 
<  3)  'jt0.  3Ygx0  >  is  monotone. 

However,  if  32YgCm Rj] CYg  is  not  monotone,  then  nothing  can  be  said  about 
whether  or  not  the  LQG/LTR  technique  is  valid,  because  Lemma  4.3.2  only  provides 
a  sufficient  condition,  as  opposed  tc  necessary  and  sufficient.  Since  a  set  of  physically 
meaningful  conditions  was  not  obtained  to  ensure  the  desired  strong  convergence, 
one  may  try  to  apply  the  procedure  in  an  ad  hoc  fashion,  or  one  may  try  to  use 
another  approach  to  achieve  robustness.  One  alternative  is  to  try  to  approximate 
the  LQG/LTR  procedure.  The  next  section  will  look  at  using  the  approximation 
approach  of  Banks  [7]  as  a  way  to  approximate  the  LQG/LTR  procedure. 

4-4  LQG/LTR  Approximation 

With  Schumacher’s  approach  (see  Chapter  3),  one  first  must  have  an 
infinite-dimensional  compensator  that  he  wants  to  approximate.  For  the  LQG  de¬ 
sign,  this  means  having  to  solve  an  infinite-dimensional  algebraic  Riccati  equation 
(A.R.E.),  which  may  be  extremely  difficult  to  do.  However,  assuming  one  can  per¬ 
form  this  solution,  one  really  has  only  two  known  parameters  to  adjust  for  robust¬ 
ness.  These  are  the  exponential  time  constant  for  the  case  of  bounded  perturbations, 
and  the  semigroup  gain  constant  for  relative  bounded  perturbations,  as  discussed 


So 


in  Section  4  of  Chapter  3.  Therefore,  when  using  Schumacher’s  approach,  it  would 
seem  that  one  would  want  to  make  the  exponential  time  constant  as  negative  as 
possible  and  the  gain  constant  as  small  as  possible  in  order  to  improve  robustness. 

Another  approach  to  robust  LQG  controller  design  would  be  to  make  the 
robustness  recovery  a  part  of  the  A.R.E.  This  is  the  idea  behind  the  LQG/LTR 
technique.  In  this  way  one  “tunes”  the  filter  in  order  to  regain  the  guaranteed 
robustness  of  the  LQ  regulator  [30],  or  one  can  use  Kwakernaak  and  Sivan’s  [49] 
dual  procedure,  depending  on  on  the  point  in  the  loop  where  one  chooses  to  enhance 
robustness.  If  one  chooses  to  enhance  robustness  at  the  input  to  the  plant  (point 
4  of  Figure  1  in  Chapter  2),  then  one  can  use  Doyle  and  Stein’s  approach  [62] 
to  recover  the  loop  transfer  function  of  the  regulator  at  the  plant  input.  If  one 
enhances  robustness  at  the  plant  output  (point  1  of  Figure  1  in  Chapter  2),  one  can 
use  the  dual  procedure  of  Kwakernaak  and  Sivan  [49]  to  recover  the  loop  transfer 
function  associated  with  the  Kalman  filter  at  the  plant  output.  However,  if  one  were 
able  to  apply  the  LQG/LTR  technique  validly  for  our  class  of  systems,  one  would 
still  have  to  solve  an  infinite-dimensional  A.R.E.,  and  then  use  some  technique  to 
approximate  the  desired  “robust”  compensator.  The  problem  is,  that  it  is  not  known 
if  the  LQG/LTR  technique  can  be  validly  applied  to  the  entire  class  of  distributed 
systems  considered  in  this  research. 

One  way  to  approach  designing  a  robust  compensator  might  be  to  approxi¬ 
mate  the  infinite-dimensional  A.R.E.  with  a  sequence  of  finite-dimensional  A.R.E.s 
such  that  the  sequence  of  solutions  converges  to  the  infinite-dimensional  A.R.E.  so¬ 
lution,  as  done  in  [7],  In  this  way,  one  could  approximate  the  desired  solution,  and 
perform  robustness  enhancement  on  the  approximation.  Thus,  one  could  possibly 
approximate  the  LQG/LTR  technique  for  the  entire  class  of  systems. 

In  order  to  make  direct  use  of  the  results  of  [7],  the  dual  robustness  recovery 
procedure  of  Kwakernaak  and  Sivan  will  be  considered.  By  duality,  the  type  of 
results  obtained  are  applicable  to  the  robustness  recovery  procedure  of  Doyle  and 
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Stein.  For  that  approach,  one  merely  has  to  consider  the  dual  A.R.E.  and  the 
operators  associated  with  it.  The  development  that  follows  involves  the  A.R.E. 
associated  with  the  LQ  regulator  gain  operator  Kc  (see  Equation  (34)).  The  operator 
II  used  by  Banks  is  the  same  as  the  operator  Pc  that  solves  Equation  (34). 


Following  the  presentation  by  Banks  [7],  and  using  his  notation,  II  €  £("H)  is 
a  solution  of  the  A.R.E.  given  by 


Am n  +  n a  +  qc-  UBR;'Bmn  =  o 


(121) 


if  fl  maps  D(A)  into  D(Am)  and  if  II  satisfies  the  A.R.E.  on  D(A). 


One  thing  to  note  is  that,  this  A.R.E.  is  actually  an  inner  product  equation. 
The  inner  product  notation  has  been  dropped  in  order  to  simplify  the  writing  of 
the  equations.  Kwakernaak  and  Sivan’s  approach  to  robustness  recovery  involves 
modifying  the  state  cost  weighting  operator  Qc,  by  adding  the  additional  cost  term 
q2CmVC  to  Qc.  Then,  as  q  — >  oo,  one  is  able  to  asymptotically  recover  the  loop 
transfer  function  associated  with  the  Kalman  filter,  at  the  plant  output.  The  prob¬ 
lem  with  this  LQG/LTR  technique  is  that,  in  order  to  converge  to  the  guaranteed 
stability  robustness  of  the  filter,  one  must  show  that  (see  Chapter  3  for  the  dual 
discussion) 


lim  q2  <  UBR;lBmnh,k  >  =  <C’VCh,k>  Vh,  k  £  D(A)  (122) 


implies  strong  convergence  [51].  Matson  [51]  has  proven  the  dual  case  (and  thus  this 
case  by  duality)  when  A *  is  a  finite-dimensional  (i.e.  bounded)  operator,  and  also 
when  R(B)  Li  R(Q j)  is  contained  in  a  finite-dimensional  space  spanned  by  a  finite 
number  of  eigenfunctions  of  A *. 


Following  the  development  of  Banks  [7],  the  infinite-dimensional  state  space 
problem  given  by 

x  =  Ax  +  Bu  xQ  £  D(A)  (123) 


y  =  Cx 


(124) 
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where  x  G  ?t,  can  be  redefined  by  projecting  it  onto  a  finite-dimensional  subspace  of 
H  (denoted  Hk)  by  means  of  an  orthogonal  projection  Pk  such  that  Pk  :  H  — »  Tik- 
A  projection  Pk  is  said  to  be  orthogonal  if  its  range  and  null  space  are  orthogonal, 
if  pkpk  =  Pky  and  if  each  h  £  Ti  can  be  written  uniquely  as  h  =  r  -f  n  where  r  is 
in  the  range  of  Pk ,  and  n  is  in  the  null  space  of  Pk.  Also,  an  orthogonal  projection 


is  continuous. 


This  projection  is  used  to  define  the  operators  Ak,  Bk,  Ck  and  Qk  as  follows: 


PkA  =  Ak£  C(Hk) 


PkB  =  Bk  €  C(X'-,Hk) 


PkC  =  Ck  € 

PkQc  =  Qk  G  C(Hk) 


(125) 


(126) 

(127) 


(128) 


Using  these  operators,  the  family  of  finite-dimensional  regulator  problems  described 


x  =  Ak x  +  B  u;  x(0)  =  P  x0 
V  =  Ckx 


with  associated  cost  functional  given  by 


Jt  OC 

'  [<  Qkcx,  x  >  -I-  <  RCU<U  >}dt 

0 


(129) 

(130) 


(131) 


can  be  considered.  It  will  also  be  necessary  to  make  the  following  assumptions  on 
each  finite-dimensional  problem: 


1.  For  each  x0  G  Tf*,  there  exists  an  admissible  control  u  G  L1 2{ 0,  oo;  U)  such  that 
the  cost  functional  Jk  is  finite 

2.  (a)  Qc  is  positive  semi-definite  on  H,  as  is  PkQc  on  Hk  for  all  k 

(i.e.  <  Qcx,x  >  >0  Vx  G  Ft  )  and  <  Qkx,x  >>  0  Vx  G  Tik 
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(b)  Rc  is  positive  on  the  input  space  U  (i.e.  <  Rcit,u  >  >  0  Vtt  6  U  ) 

3.  (a)  Pk  -»  /  as  k  — ♦  o©  in  the  sense  that,  for  any  i  G  Ti,Pkx  — ►  x  as  fc  — ►  oo 

(b)  Tk(t)Pkx  — ►  T(t)i  as  t  — ►  oo,  where  !T(<)  is  the  semigroup  generated  by 
the  operator  A 

(c)  Tmk(t)Pkx  — »  T'(t)x  as  k  — »  oo,  where  T’(t)  is  the  dual  semigroup 
generated  by  A' 

(d)  Bku  — ►  Bu  and  B'kx  — ►  B'x  as  k  — *  oo 

(e)  QkPh  —*  Qcx  as  k  — *  oo 

Assumption  1  is  a  standard  LQG  assumption  and  is  satisfied  by  our  assump¬ 
tions  of  stabilizability  and  detectability  made  in  Chapter  1  and  in  Chapter  3.  Specif¬ 
ically,  it  is  assumed  that  ( A ,  B)  and  ( A ,  G)  are  stabilizable,  and  (A,  C)  and  (A,  Q\^) 
are  detectable.  Assumption  2  is  made  in  order  to  use  the  results  of  [51]  and  it  is  not 
very  restrictive  in  applications.  If  assumption  1  holds,  then  the  optimal  control  for 
each  finite-dimensional  problem  is  given  by 

uk  =  -R~'B,kY[kx  (132) 

where  FI*  G  £(7^)  is  the  unique  nonnegative  self-adjoint  solution  of  the  A.R.E.  on 
Hk  given  by 

A.knk  +  ukAk  +  Qk  _  Bk R-' Bmk\lk  =  0  (133) 

Assumptions  3  a-f  can  be  satisfied  by  many  approximation  schemes,  for  example 
modal  approximation  [7],  so  that  these  assumptions  are  not  overly  restrictive.  In 
fact,  3(a)  implies  3(d)  since  B  is  a  bounded  linear  operator.  The  assumption  that 
( A,B )  is  exponentially  stabilizable  along  with  the  assumption  that  (A,QlJ2)  is  ex¬ 
ponentially  detectable  (as  is  done  in  this  research)  allows  the  hypothesis  of  Theorem 
2.2  of  [7]  to  be  satisfied  for  a  large  class  of  distributed  parameter  systems  using  sev¬ 
eral  appproximation  schemes  (i.e.  modal,  spline,  Ritz,  etc.  [36]).  The  following 
theorem  is  taken  from  [7], 


THEOREM  4.4.1  :  Suppose  that  the  previous  Assumptions  1  thru  3(e) 
hold.  Let  Qc  >  0,  Rc  >  0,  and  let  11*  denote  the  unique  nonnegative  self-adjoint 
Riccati  solution  on  Ti*.  Also  assume  that  a  unique  nonnegative  self-adjoint  Riccati 
operator  II  exists  for  the  problem  defined  on  H .  Let  Sk(t)  and  S(<)  be  the  semigroups 
generated  by  ( Ak  —  Bk  R~'  B’kTlk)  and  {A  —  BR~' B’Tl)  on  W*  (a  finite-dimensional 
subspace  of  the  Hilbert  space  Ti)  and  H  respectively,  and  let  ||  S(t)x  ||— ►  0  as 
/  ->  oo  Vj  £  Ti.  If  there  are  two  positive  constants  (A/j,A/2)  and  u>  <  0  that  are 
all  independent  of  both  k  and  t  such  that 

i)  ||  Sk(t)  ||  <  A/,ew'  Vt  >  0  and  k  =  1,2, ... , 

ii)  ||  n*  ||  <  a/2 

then,  as  k  — +  oc, 

a)  n kpkx  n.r  vxen 

b)  Sk(l)Pkx  —  5(t)x  Vx  €  n 

where  the  convergence  is  uniform  in  t  on  bounded  subsets  of  [0,oc),  and 
||  5(t)  ||  <M,eut  Vt>  0,  u;  <  0 


Proof:  See  Banks  (7]  page  695. 


Note  that,  since  the  LQ  regulator  generates  a  stable  semigroup  (see  Section 
4  of  Chapter  2),  then  ||S(<)x||  — ►  0  as  t  — ►  oo.  Thus,  using  this  approach,  one 
can  approximate  the  solution  of  the  infinite-dimensional  A.R.E.  with  a  sequence  of 


finite-dimensional  A.R.E.’s.  Banks  [7]  demonstrates  that  the  hypothesis  of  Theo¬ 
rem  4.4.1  can  be  satisfied  by  many  popular  approximation  schemes  (such  as  modal, 
spline,  etc).  Once  the  solution  is  approximated  closely  enough,  then  one  could  ap¬ 
ply  the  LQG/LTR  technique  using  the  finite-dimensional  A.R.E.  The  drawback  to 
this  approach  is  that  guaranteed  stability  margins  to  be  approached  asymptotically 
are  only  with  respect  to  the  finite-dimensional  model,  not  the  infinite-dimensional 
model.  However,  models  are  always  an  approximation  of  reality.  The  idea  is  to 
choose  a  model  that  matches  the  real  world  well  enough  so  that  the  compensator’s 
robustness  can  tolerate  the  model  uncertainty.  One  also  wants  robustness  to  deal 
with  model  perturbations  for  the  case  when  a  system  changes  during  operation. 
Even  DPS  models  are  approximations,  but  they  are  often  used  because  they  are  bet¬ 
ter  approximations  for  some  systems  than  finite-dimensional  models.  Since  Banks’ 
approach  involves  approximating  the  DPS  solution  by  approximating  the  associ¬ 
ated  infinite-dimensional  A.R.E.  with  a  sequence  of  finite-dimensional  A.R.E’s.,  the 
development  of  this  section  can  be  viewed  as  an  approximation  of  the  LQG/LTR 
technique. 

If  perturbations  are  modeled  as  finite-dimensional,  then  this  approach  can  be 
used  to  get  a  desirable  compensator.  If  not,  then  this  approach  provides  added 
robustness  with  respect  to  a  finite-dimensional  model  which  can  be  made  arbitrarily 
close  to  the  DPS  under  consideration.  In  this  way  one  can  say  he  is  approximating 
the  LQG/LTR  technique  on  the  infinite-dimensional  system.  However,  for  DPS 
for  which  the  LQG/LTR  is  not  known  to  be  valid,  it  is  not  clear  what  type  of 
robustness  is  achieved  in  the  limit  as  the  order  k  of  the  approximation  goes  to  oo.  It 
is  believed  that  the  approximation  technique  will  yield  desirable  results.  However, 
the  LQG/LTR  technique  is  just  one  way  to  achieve  robustness.  Other  approaches 
are  available,  as  will  be  discussed  in  Chapters  5  through  7. 


This  chapter  presents  sufficient  conditions  that  allow  the  LQG/LTR 
technique  to  be  extended  to  a  class  of  problems  of  interest.  In  particular,  Theorem 
4.2.1  gives  conditions  based  on  the  operator  I\p  =  (BV  Bm+/3~2Q  j—(3~2YpC‘  Rj'CYp) 
It  is  shown  that,  if  Kp  is  uniformly  bounded  independent  of  /?,  and  if  Kp  is  posi¬ 
tive  semi-definite,  then  the  LQG/LTR  technique  is  valid  for  the  class  of  problems 
that  satisfy  the  assumptions  of  Section  3  in  Chapter  1.  Theorem  4.2.1  is  based  on 
a  different  development  than  that  found  in  Matson’s  work  [51],  and  may  provide 
insight  as  to  how  to  extend  the  LQG/LTR  technique  to  the  entire  class  of  problems 
without  any  conditions  on  Kp. 

Section  4.3  discussed  the  reason  many  people  have  not  considered  strong  con¬ 
vergence  an  issue.  Since  the  A.R.E.  has  a  bounded  extension  to  the  entire  Hilbert 
space  'H,  some  have  simply  assumed  strong  convergence.  It  is  shown  in  Section 
4.3,  that  weak  convergence  does  exist  for  the  class  of  problems  considered  in  this 
research.  Section  4.3  also  has  a  second  set  of  sufficient  conditions  that  allow  the 
LQG /LTR  technique  to  be  extended.  The  conditions  are  not  physically  meaningful, 
but  Lemma  4.3.3  provides  yet  another  approach  to  solving  the  problem  of  extending 
the  LQG/LTR  technique. 

Since  the  technique  has  not  been  extended  to  the  entire  class  of  problems  con¬ 
sidered  in  this  research,  an  approximation  of  the  technique  is  developed,  based  on 
the  work  of  Banks  [7].  Section  4.4  shows  how  to  approximate  the  LQG/LTR  tech¬ 
nique  by  approximating  the  infinite-dimensional  A.R.E.  with  a  sequence  of  finite¬ 
dimensional  A.R.Es.  Since  the  LQG/LTR  technique  is  valid  for  finite-dimensional 
systems,  then  one  can  use  the  finite-dimensional  A.R.E.’s.  to  approximate  the  tech¬ 
nique. 

The  LQG/LTR  technique  is  just  one  way  to  achieve  robustness.  Another 
technique  being  currently  taken  is  the  optimal  projection  equation  (O.P.E.)  approach 


developed  by  Bernstein  and  others.  The  n 
based  on  the  work  by  Bernstein  [10]. 
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V.  Optimal  Projection  Equations 


5. 1  Introduction 

Another  approach  being  currently  taken  to  address  the  problem  of  ro¬ 
bust  reduced  order  controllers  [10,  11,  46,  9,  45,  39,  40]  is  to  fix  the  order  of  the 
compensator  based  on  physical  constraints,  and  determine  the  optimal  robust  con¬ 
troller  using  the  optimal  projection  equation  approach  [11]. 

Ignoring  the  issue  of  robustness  for  the  moment,  Bernstein  [10]  gives  a  set  of 
necessary  conditions  for  a  reduced  order  controller  to  be  the  “optimum  controller’'. 
A  controller  will  be  considered  “optimum”  if  it  stabilizes  the  system  at  design  con¬ 
ditions,  and  if  it  produces  a  feedback  control  law  that  minimizes  a  desired  cost 
functional  which  characterizes  the  system’s  steady  state  performance.  The  cost 
functional  to  be  minimized  will  be  of  the  form 

J  =  lim  £[<  Qcx{t),x(t)  >  +  <  Rcu(t),u(t)  >] 

where  £  denotes  the  expectation  operator.  This  is  discussed  in  more  detail  in  Section 
3. 

Let  A  and  T  be  a  bounded  linear  operators  mapping  W  -*  S*  (where  k  is 
the  dimension  of  the  finite-dimensional  controller)  such  that  TA*  =  /*.  /*  is  the 
identity  operator  on  The  conditions  developed  by  [10]  are  a  pair  of  modified 
Riccati  equations  and  a  pair  of  coupled  Lyapunov  equations.  The  two  modified 
A.R.E.s  are  given  by 

AQ  +  QA'  +  Qj  -  QC’RfCQ  +  t±QC'R]'CQt'x  =  0  (134) 

AmP  +  PA  +  QC  -  PBR;'B'P  +  T'±PBR;'BmPr±  =0  (135) 

and  the  two  Lyapunov  equations  are  given  by 

(A-BRj'B'PjQ+QiA-BR^B’Py+QC’Rj'CQ-Tj.QC-Rj'CQTl  =0  (136) 


( A-QCmR]1C)mP+P{A-QCmR]lC)^PBR;lB’P-T,±PBR;1BmPT±  =  0  (137) 


where  the  operator  r  is  defined  by  the  the  operators  A  and  T  (r  =  A*T)  which 
determine  the  projection  of  the  full  order  compensator  to  a  fixed  order  compensatoi . 
The  projection  operator  t±  satisfies  the  relation 


T±  =  J-T  =  J-  AT 


(138) 


and  using  the  operators  A  and  f.  the  compensator  is  defined  by  the  equations 


xc  =  Actc  +  Bcy 


(139) 


u  =  Ccxc 


(140) 


where  Ac.  Bc  and  Cc  are  given  by 


ac  =  r(.4  -  qc-r]'c  -  br;}B'P) a* 


(141) 


Bc  =  TQC'R? 


(142) 


Cc  =  -R;'BmP\’ 


(143) 


Notice  that  the  Lyapunov  equations  are  coupled  to  the  A.R.E.s  by  the  pro¬ 
jection  operator  tx.  If  the  order  of  the  system  equals  the  order  of  the  compensator, 
then  t±  =  0,  and  one  gets  the  standard  LQG  A.R.E.s,  and  the  Lyapunov  equations 
become  decoupled  from  the  A.R.E.s.  In  that  case,  the  Lyapunov  equations  can  be 
satisfied  separately  from  the  A.R.E.s,  and  the  standard  LQG  results  are  obtained. 
For  the  case  when  the  order  of  the  compensator  is  less  than  the  system  order,  one 
might  wonder  if  the  optimum  projection  equations  (O.P.E.)  can  be  modified  not 
only  to  stabilize  the  system  and  minimize  the  associated  cost  functional  J,  but  also 
to  provide  robustness  as  is  done  using  the  LQG/LTR  technique.  The  next  section 
will  consider  whether  or  not  loop  transfer  functions  can  be  recovered  when  the  order 
of  the  compensator  is  less  than  or  equal  to  the  order  of  the  system. 


-  v 
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Figure  4.  System  with  Finite-Dimensional  LQG  Based  Controller 

5.2  Loop  Recovery  with  Reduced  Order  Controllers 

Let  A  and  T  be  the  bounded  linear  operators  that  define  the  projection 
of  the  full  order  compensator.  Figure  4  represents  the  infinite-dimensional  system 
using  the  finite-dimensional  controller. 

The  infinite-dimensional  system  is  described  by  the  equations 

i  =  Ax  +  Bu  (144) 

y  =  Cx  (145) 

and  the  compensator  is  described  by  Equations  ( 1 39)-(  143).  With  AC,BC  and  Cc 
given  as  in  Equations  (141 )-( 143),  the  compensator  state  equations  can  be  written 
as 

xc  =  (r/4A*  -  TA'/CA*  -  YBKc\')xc  +  YKjy  (146) 

or: 

ic  =  r/4A*ic  +  TBu  +  TKf{y  -  C\'xc)  (147) 

where  tt  =  —Kc A*ic. 

The  system  input  appears  at  point  4  in  Figure  4.  This  point  is  physically 
important  since  it  is  one  point  where  the  compensator  interfaces  with  the  system 
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being  controlled  (the  other  point  that  is  important  is  point  1  where  the  system 
output  iuterfaces  with  the  compensator).  The  transfer  function  at  point  4  is  given 
bv 


C4(s)  =  K(s)P(s)  =  Cc(sl  -  Ac)~'BcC(sI  -  A)~'B  (148) 

which  can  be  written  as 

G4(5)  =  +  T  A'yCA*  +  r  Bl\cA’)~l  T  K  jC$pB  (149) 

where  tlie  controller  state  transition  operator  is  =  (si  —  T/IA*)-1  and  the  plant 
state  transition  operator  is  $p  =  (si  —  A)~l .  Since  A  generates  a  C0  semigroup, 
(si  —  .-1)_1  will  exist,  (si  —  T.4A*)-1  will  exist  since  IMA*  is  a  finite-dimensional 
operator.  Note  that  when  the  order  of  the  compensator  is  less  than  order  of  the 
system,  <t>,-  does  not  equal  4>p.  For  infinite-dimensional  systems,  the  state  transition 
operator  is  the  semigroup  T(i)  which  is  generated  by  the  operator  A. 

In  a  similar  fashion  one  can  write  the  transfer  function  at  point  3  in  the 
system.  This  is  the  transfer  function  that  one  would  try  to  recover  at  point  4  using 
the  LQG/LTR  technique  for  robustness  enhancement.  This  point  is  internal  to  the 
compensator,  and  has  guaranteed  robustness  properties  as  discussed  in  Section  4  of 
Chapter  4.  Using  the  equations 


u  ~  —I\cA‘xc 


(150) 


and 

y  =  C$pBu'  (151) 

where  u'  is  the  input  at  point  3,  the  state  xc  can  be  expressed  as 

x c  =  (si  -  TAA-)-'rBu'+(sI  -  rAA'j-'TKjy  -  (si  -  TAA’)^TKjCA'xc  (152) 

or  equivalently 

ic  =  (/  +  SerA'/CA-^i^rtfu'  +  $crA>]  (153) 
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Substituting  for  y  via  Equation  (151),  and  rearranging  terms,  the  stat^  .an  be 
written  as 

xc  =  (/  +  <Dcr/vCA*)-,($cr)(/  +  KjC*p)Bu'  (154) 

Substituting  this  into  the  expression  for  u,  Equation  (150),  the  loop  transfer  function 
at  point  3  is  given  as 

G3(s)  =  -KCA'(I  +  +  KjC*p)B  (155) 

If  the  order  of  the  compensator  equals  the  order  of  the  system,  then  t  is  an  identity 
operator  (and  t±  is  a  zero  operator),  and  from  Equation  (155)  it  is  clear  that  the 
loop  transfer  function  at  point  3  can  be  expressed  as 

G3{s)  =  -Kc$pB  (156) 

Since  4>c  does  not  equal  $p  when  a  reduced  order  controller  is  used,  then 
one  cannot  recover  a  desired  transfer  function  that  involves  an  infinite- dimensional 
design  model.  Note  that,  since  any  model  is  an  approximation  of  the  true  system, 
then  the  controller  order  will  always  be  less  than  the  true  system  order.  The  issue 
considered  here  is  the  case  when  the  controller  order  is  less  than  the  design  model 
order.  The  design  model  is  the  mathematical  model  one  chooses  to  describe  the 
physical  system  to  be  controlled,  and  as  such,  it  is  an  approximation  of  the  true 
system.  In  practice,  one  assumes  that  the  design  model  is  the  true  system  so  that 
a  result  can  be  synthesized.  Robustness  is  needed  due  to  the  fact  that  the  design 
model  does  not  equal  the  true  system  being  controlled.  Thus,  loop  transfer  recovery 
using  a  finite-dimensional  controller  can  only  be  accomplished  using  a  reduced  order 
model. 

5.3  O.P.E.  Robustness 

The  O.P.E.  approach  allows  one  to  achieve  robustness  by  modifying  the 
infinite-dimensional  A.R.E.,  and  will  give  a  new  interpretation  of  LQG/LTR  when 


the  controller  is  finite-dimensional  but  the  design  model  is  infinite-dimensional.  The 
O.P.E.  approach  provides  a  way  to  achieve  robustness  to  uncertainty,  and  to  min¬ 
imize  the  cost  functional  J,  at  conditions  other  than  the  nominal  design  condition 
[40], 

For  a  fixed  order  compensator  where  k  <  dimTi  =  oo,  one  wants  to  deter¬ 
mine  the  operators  {Ac,  Bc.Cc)  such  that  the  closed-loop  system  consisting  of  the 
controlled  system 

x  =  (.4  +  A.4);r  -f  (B  +  A B)u  (157) 

where  x  G  along  with  measurements 

y  =  (C  A  AC)x  (158) 

with  y  G  and  a  finite-dimensional  compensator  described  by 

Tc  =  Afxe  +  Bcy  (159) 

u  =  Ccxc  (160) 

is  exponentially  stable  for  all  perturbations  (A.4,  A B,  AC)  G  U  where  U  is  the  set  of 
admissible  operator  triplets  describing  the  perturbations  to  the  operators  .4,  B ,  and 
C  one  wishes  to  consider.  If,  for  instance,  one  only  allows  bounded  perturbations, 
then  U  is  the  set  of  bounded  linear  operators  which  are  bounded  by  some  constant, 
say  D.  Through  U ,  one  describes  the  robustness  desired. 

However,  in  addition  to  being  exponentially  stable,  one  also  would  like  to 
minimize  the  cost  functional  associated  with  the  optimal  control  problem  at  other 
than  design  conditions.  This  will  be  made  clearer  later,  in  Equation  (165).  The  cost 
functional  to  be  considered  is  denoted  by  J  and  will  be  defined  as 

J(.4r,  £?c,  Cc)  =  lim  €[<  Qcx(t),x(t)  >  +  <  Rcu{t),u(t)  >]  (161) 

where  £  is  the  expectation  operator  and  is  defined  as  [29] 


where  ^  is  the  space  of  all  possible  u>  that  the  random  variable  i(t)  maps  to  some 
Borel  space  over  which  a  probability  measure  P  is  defined.  This  cost  functional  is 
chosen  instead  of  the  one  given  by  Equation  (33)  since  the  objective  of  the  O.P.E. 
approach  is  to  achieve  optimum  steady  state  performance,  and  not  necessarily  op¬ 
timum  performance  over  the  entire  time  interval. 

For  a  reduced  order  compensator  where  k  <  dim'H ,  one  wants  to  determine 
(Ac.  Bc,Cc)  such  that  when  the  closed-loop  system  consisting  of 


x  =  (.4  +  AA):r  +  {B  -f  A D)u  +  Gw 


(163) 


with  noisy  measurements  given  by 


y  =  (C  +  A  C)x  +  T) 


(164) 


is  coupled  with  the  compensator,  the  steady-state  performance  cost  functional 
J(Ac.Bc,Cc)=  sup  lim  £[<  Qcx(t),x(t)  >  +  <  Rcu{i),u{t)  >]  (165) 

(A.4,AB,AC)€^  (~*<x' 

is  minimized.  In  other  words,  one  wants  to  design  a  controller  so  that  the  largest 
value  that  the  cost  functional  can  take  on  for  all  possible  perturbations  is  minimized. 
In  the  development  that  follows,  G  is  assumed  to  be  the  identity  operator  (without 
loss  of  generality)  in  order  to  correspond  to  the  development  of  Bernstein  [9], 

A  control  will  be  considered  admissible  only  if  it  forces  the  cost  functional  J 
to  take  on  a  finite  value.  To  help  simplify  the  notation,  the  closed-loop  system  can 
be  written  in  terms  of  the  augmented  state-space  H  =  H  ©  It  is  assumed  that 
the  noise  terms  vc  and  tj  are  independent.  In  terms  of  the  augmented  state  vector 


x  =  \x  xcy 


(166) 


this  yields 


~x  =  (A  +  AA)i  +  G( 


(167) 


£[C(OCt(*  +  t)]  = 


A  A  = 


r)]=  6{t) 

0  Rj 

A  BCc 
BcC  Ac 

AA  A  BCc 
BcAC  0 


-  Q0  0 

V  =  G  G' 

0  Rj 


0  BcRjB ‘c 


Also,  in  terms  of  x,  the  performance  cost  functional  can  be  written  as 


J(Ac,Bc,Cc)  =  sup  lim  £"[<  .ftx,x  >] 
(A/4,AB.AC)€W‘-’0° 


(168) 


where 


Qc  0 
R=  Vc 

0  Cj  RcCc 

The  following  lemma  allows  one  to  express  the  cost  functional  in  terms  of  the 
second  moment  of  x(<).  This  will  be  needed  so  that  an  upper  bound  of  the  cost 
functional  can  be  established  in  a  theorem  to  follow. 


LEMMA  5.3.1:  For  (Ac,  Bc,Cc)  and  {AA,AB,AC)  £  U ,  the  performance 
cost  functional  can  be  expressed  in  terms  of  the  covariance  of  x(t),  defined  as: 

«4<0  =  f[(i( <)-«(<))(*(<) -«(«))•) 

Furthemore,  if  the  system  is  stable  for  all  ( AA,  A B,  AC)  €  U ,  then  the  performance 
cost  functional  can  be  expressed  as 

J{Ac,Bc,Cc)  =  sup  <r[<5AA] 

(&A,&B,AC)eU 

where  tr  denotes  the  trace  operator,  and  where  <jA  satisfies  the  equation 

(A  +  A.4)Qa  +  Qa(A  +  AA)*  +  V  =  0 

Proof:  Balakrishnan  [l],  page  317,  defines  the  covariance  of  x(t)  as  the 
nonnegative-definite  operator  Q^(<)  given  above.  Bernstein  and  Hyland  [10],  Lemma 
4.1,  page  137,  prove  that  J(Ac<Bc,Cc)  =  sup(A4  AB  /r[QA^]  and  Lemma  4.4. 
page  139  [  1 0]  proves  that  satisfies  the  last  equation  of  Lemma  5.3.1.  Q.E.D. 

In  the  development  to  follow,  the  operator  V  will  be  modified  by  a  nonnegative 
operator  T.  A  result  that  will  be  needed  is,  if  (V1/2,.4  -f  AA)  is  detectable,  then 
so  is  ([L  -f  T]1/2,  A  +  AA)  under  certain  conditions.  The  following  theorem  from 
Wonham  [68]  gives  conditions  under  which  the  property  of  detectability  is  preserved. 

THEOREM  5.3.2:  Let  H  be  a  real  Hilbert  space,  and  let  Mm  be  a  bounded 
linear  operator  mapping  H  — ►  H.  If  Mm  is  a  nonnegative  operator  and  if  (A/,]/2,  A) 
is  detectable,  then  for  all  nonnegative  operators  N,  the  pair  ([A/m  +  Ar]1/2,A)  is 
detectable. 


Proof:  See  Wonham’s  book  [68]  page  79,  and  let  the  operators  of  Theorem 
3.6,  Q  and  B ,  be  such  that  Q  —  B  =  0.  Q.E.D. 

The  next  theorem  is  the  maun  theorem  of  this  section,  and  it  provides  suf¬ 
ficient  conditions  for  robust  stability  and  optimum  performance.  In  the  theorem 
to  follow,  the  operator  fi  is  a  positive  self-adjoint  operator  that  “bounds”  the  un¬ 
certainty  described  by  the  operator  A  A.  The  operator  fi  is  part  of  a  Lyapunov 
condition  involving  the  nominal  system  operators.  The  operator  Q  is  the  bounded 
positive-semidefinite  self-adjoint  operator  solution  for  the  Lyapunov  condition,  and 
is  the  only  unknown  in  the  Lyapunov  equation.  It  is  assumed  that  fi  and  Q  both 
exist.  Satisfying  the  Lyapunov  equation  will  ensure  stability  in  the  presence  of  per¬ 
turbations  described  by  the  operator  AA.  The  next  theorem  demonstrates  that  the 
operator  fi  is  also  a  function  of  the  operator  Q. 


THEOREM  5.3.3:  Let  fi  :  H  — *  *H  be  a  self-adjoint  positive  operator  such 
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i)  <  AA’x,Qt  >  +  <  Qx,  AA'x  >  <  <  fix,  x  >  Vx  <E  H 

for  all  (A.4,  A B,  AC)  €  U . 

Also,  for  a  given  (Ac,  Bc,Cc),  assume  that  there  exists  a  Q  £  S  (where  S  is  the 
class  of  bounded,  positive-semidefinite,  self  adjoint  operators)  such  that  Q  satisfies 
the  equation 

ii)  AQ  +  QA'  +  Q  +  V  =  0 

on  D(A). 

In  addition,  assume  that  (V1/2,  A  +  AA)  (where  AA  is  defined  by  Equation 
(167)  is  detectable  for  all  (AA,  AB,  AC)  €  U .  Then,  A  + AA  is  exponentially  stable 
for  all  (AA,  AB,  AC)  €  U.  Also, 

Qa  <2 
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where  Qa  satisfies  Equation  (ii)  and 


J(Ac,Bc,Cc)<tr[QR ] 


Proof:  Following  Bernstein  [9,  40],  and  recalling  Lemma  5.3.1,  for  all 
(A.4.  AB,  AC)  €  U ,  Equation  (ii)  is  equivalent  to 

(A  +  AA)Q  +  Q(A'  +  A.4")  +  V  +  T(£,  Bc,  Cc,  A  A)  =  0 

where  T  =  fi  —  (A.4Q  +  £?A.4"). 

Notice  that,  by  Equation  (i),  T  is  nonnegative  for  all  (A4,  A5,  AC)  £  £/. 
Since  (\'1/2,i  +  A  A)  is  assumed  detectable,  then  by  Theorem  5.3.2,  it  follows  that 
([  \  ’  +  T]1/2,  +  A.4)  is  detectable  for  all  (A.4,  AB,  AC)  £  U.  Bernstein  [10]  Lemma 

4.1  gives  that  this  detectability  condition,  along  with  the  assumption  that  Q  is 
bounded,  implies  that  {A  +  A.4)  must  be  stable. 

Next,  subtracting 

(A  +  AA)Q&  +  Qa(-4  +  A.4)"  4-  V  =  0 
(which  is  a  result  from  Lemma  5.3.1)  from  the  first  equation  in  this  proof, 

(A  +  A  A)Q  +  Q{A *  +  A.4")  +  V  +  T  =  0 

yields  that 

(A  +  A A){Q  -  Q±)  +  (Q  -  Q*){A'  +  AAm)  +  T  =  0 

Since  Bernstein  [10]  Lemma  4.1  yields  that  ( A  +  A.4)  is  stable,  then  Lemmas  4.4 
and  4.1  of  [10]  allow  one  to  write 

Q_-Qt  =  T{t)tT'{t)dt  >  0 


.rww  V.V^.'T.V  ’.'V  ,-w  V  ■  YTTTVT  JW.’Y.’W W  V. 


1'k.i  l^'U'U  lA* 
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where  T(f )  is  the  semigroup  generated  by  (A  +  AA).  Thus,  Q  >  Qa  and  as  a  result 

<r(Qfl]  >  fr[(?A/?] 
for  all  (AA,AB,  AC)  £  U,  so  that 

J(Ac,Bc,Cc)  <  tr[QR } 

Note  that  since  Q  is  bounded,  then  this  last  inequality  places  an  upper  bound  on 
the  sup  Q.E.D. 

Theorem  5.3.3  provides  a  sufficient  condition  that  ensures  robustness,  and  pro¬ 
vides  an  upper  bound  on  the  value  of  the  cost  functional  J.  By  choosing  an  operator 
ft  so  that  conditions  (i)  and  (ii)  of  Theorem  5.3.3  are  satisfied,  one  can  achieve  ro¬ 
bustness.  The  difficulty  with  the  theorem  is  the  ability  to  find  an  operator  ft  that 
satisfies  the  conditions.  One  would  like  to  choose  ft  so  that  it  reflects  uncertainty  in 
a  meaningful  way.  and  this  may  be  difficult  to  do.  Also,  the  existence  of  a  bounded 
operator  Q  is  assumed. 

5.4  Insights 

Choosing  ft  is  based  on  the  type  of  perturbations  one  wishes  to  consider, 
and  depends  on  how  one  chooses  to  model  uncertainty.  Bernstein  [9]  gives  one  choice 
of  ft  that  works  for  finite-dimensional  problems  in  which  uncertainty  is  described  in 
terms  of  stability  radius.  The  only  constraint  on  ft  is  that  it  be  chosen  so  that  the 
hypotheses  of  Theorem  5.3.3  are  satisfied.  Assuming  that  is  done,  then  using  the 
operator  ft  allows  one  to  accomplish  a  procedure  like  that  of  Bernstein  [10,  9],  so 
that  by  setting  the  Frechet  derivatives  of  the  cost  functional 

I(Q,  Ac,  Bc ,  Cc )  =  tr[\QR  +  {AQ  +  QA  +  ft  +  V)p) 

(where  A  and  p  are  nonzero  scalar  Lagrange  multipliers)  to  zero,  one  could  derive 
conditions  similar  in  form  to  those  of  Theorem  8.1  of  [9]  with  the  obvious  differ- 
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ences  due  to  operators  being  considered  instead  of  matrices.  The  exact  form  of  the 
resulting  equations  depends  on  the  form  chosen  for  ft. 

The  advantage  of  this  approach  is  that  one  can  possibly  address  perturbations 
other  than  bounded  ones.  The  disadvantage  is  that  an  algorithm  to  solve  the  com¬ 
plex  coupled  equations  is  not  readily  available.  However,  the  approach  does  allow  a 
new  interpretation  of  the  LQG/LTR  technique. 

Let  A  B  =  0  and  AC  =  0.  Then  one  obtains  that  AA  =  A  A.  Following 
the  development  of  Bernstein’s  Theorem  8.1  [9],  one  finds  that  one  of  the  necessary 
A.R.E.s  that  must  be  satisfied  is 

AQ  A  QAm  +  Q0  +  fl  -  QC'R-j'CQ  +  r±QCmR]'CQTmx  =  0  (169) 

Note  that  if  A  A  and  A.4*  are  bounded,  then  one  can  choose  f l  =  (37B\  B’, 
and  as  — *  oc  one  gets  that 

fi>AAQ  +  QAA*  (170) 

Substituting  fl  —  07BVBm  into  this  equation  yields 

BVB->AA&  +  &AA-  (171) 

and  the  work  of  Matson  [51]  demonstrates  that  the  operator  ^  monotonically  de¬ 
creases  as  /3  — *■  oo  since  Q  is  bounded.  Therefore,  one  can  achieve  robustness  to 
bounded  perturbations  by  using  a  “tuning”  procedure  like  LQG/LTR.  Note  that, 
by  doing  this,  one  does  not  asymptotically  recover  a  loop  transfer  function  with 
guaranteed  margins,  as  was  pointed  out  before.  Also,  this  form  for  fl  will  result  in 
the  other  A.R.E.  given  by 

A'P  +  PA  +  /?,  -  PBR^B'P  +  t'xPBR^B'Ptx  =  0  (172) 

which  does  not  invlove  fl.  The  only  assumption  is  that  Equation  (ii)  of  Theorem 
5.3.3  be  satisfied  in  order  to  guarantee  stability.  In  this  way  Q  will  be  admissible 


only  if  Equation  (ii)  is  satisfied,  which  will  also  ensure  that  the  cost  functional  J  is 
finite  since  Q  is  bounded. 

Thus,  LQG/LTR  can  be  viewed  as  a  way  to  achieve  robustness  even  under 
the  constraint  of  a  reduced  order  controller,  even  though  one  is  not  necessarily 
recovering  a  desired  transfer  function  asymptotically.  Also,  note  that  if  A  A  and 
A.4’  are  unbounded  operators,  then  one  cannot  find  a  /?  large  enough  to  satisfy 
Theorem  5.3.3  when  ft  is  chosen  to  be  02BVBm.  This  is  similar  to  the  problem  in 
Theorem  4.2.1  where  one  needs  to  find  a  0  sufficiently  large  so  that  Kp  is  uniformly 
bounded. 

The  O.P.E.  approach  gives  an  expanded  view  of  the  LQG/LTR  technique  when 
the  order  of  the  controller  is  intentionally  less  than  the  order  of  the  system  design 
model.  Also,  the  O.P.E.  approach  allows  one  to  choose  other  forms  for  ft  which  may 
give  more  flexibility  as  to  how  one  models  the  system  perturbations. 

5.5  Summary 

This  chapter  has  extended  the  optimal  projection  equation  robustness 
conditions  of  Bernstein  [9]  to  the  class  of  systems  described  in  Section  3  of  Chapter 
1.  The  O.P.E.  approach  for  reduced  order  controller  design  was  extended  to  infinite 
dimensional  systems  by  Bernstein  in  1986  [10].  Using  that  work,  Bernstein’s  condi¬ 
tions  for  robustness  were  extended  to  infinite-dimensional  systems  by  following  his 
development  in  [9],  Thus,  Theorem  5.3.3  is  a  result  of  his  earlier  work. 

Section  5.2  demonstrated  that  one  cannot  recover  a  loop  transfer  function 
when  the  order  of  the  controller  is  less  than  the  order  of  the  design  model.  This 
points  out  that  one  cannot  perform  loop  transfer  function  recovery  using  a  finite¬ 
dimensional  controller  and  an  infinite-dimensional  design  model.  However,  as  a 
result  of  the  O.P.E.  robustness  conditions  of  Theorem  5.3.3,  a  new  interpretation 
of  the  LQG/LTR  technique  was  given  in  Section  5.4.  It  was  demonstrated  that, 
although  loop  transfer  function  recovery  does  not  occur  when  a  finite-dimensional 


controller  is  used  along  with  an  infinite-dimensional  design  model,  one  can  achieve 
robustness  to  bounded  perturbations  by  using  the  LQG/LTR  technique.  This  is 
an  insight  not  before  mentioned  in  the  literature  since  the  LQG/LTR  technique 
has  been  used  to  recover  loop  transfer  functions,  and  thus  achieve  robustness.  The 
technique  now  has  an  expanded  interpretation.  It  was  mentioned  that  the  solution 
to  the  O.P.E.  approach  will,  in  general,  be  different  from  the  one  obtained  by  pro¬ 
jecting  the  LQG  compensator  to  finite-dimensional  space.  However,  the  lack  of  an 
algorithm  to  solve  the  coupled  equations  associated  with  the  O.P.E.  approach  makes 
it  impossible  at  this  time  to  evaluate  differences. 

The  next  chapter  will  develop  a  sufficient  condition  for  robustness  when  the 
transfer  function  is  perturbed,  instead  of  when  the  state  space  operators  are  per¬ 
turbed,  as  has  been  the  case  so  far.  The  development  is  an  extension  of  Curtain’s 
[22]  sufficient  condition  which  considered  only  additive  perturbations  of  the  system 
transfer  function. 


VI.  Transfer  Function  Approach 


6.1  Introduction 


Another  approach  taken  in  recent  literature  [16,  22,  33,  34,  30,  47]  has 
been  to  consider  perturbations  of  the  nominal  plant  transfer  function  instead  of  the 
state-space  operators.  Let  the  nominal  plant  transfer  function  be  given  by 


Gnom(s)  =  CnomT(t)Bn 


(173) 


where  T(t)  is  the  C0  semigroup  generated  by  Anom.  This  has  the  corresponding 


state  equations 


^nom  —  AnornTnom  4-  BnornXl 


y^om  —  Gnom  ? nom 

Similarly,  denote  the  perturbation  of  the  plant  transfer  function  by 


(174) 

(175) 


G6(s)  =  CtTt(t)Bs 


(176) 


where  Tf(t)  is  a  C0  semigroup  generated  by  an  operator  As-  The  corresponding 


state  equations  are 


x6  =  A6t6  4-  B(,u 
ys  =  Csx6 


(177) 

(178) 


For  additive  perturbations  of  the  transfer  function,  the  perturbed  plant  has 
the  transfer  function  given  by 


G(s)  —  G  nom  (s)  4-  G6(s) 


(179) 


which  can  be  written  equivalently  as 


G(s)  =  [C  Ct] 


T(t)  0 
0  7i(t) 


(180) 


F: 


K: 


One  thing  to  note  is  that,  .4^  that  generates  7i(<)  is  not  equal  to 
Anom  4-  AA,  where  AA  denotes  a  perturbation  of  the  system  A  operator  (as  was  the 
case  in  Chapter  5).  This  chapter  deals  with  perturbations  of  the  transfer  function, 
and  not  perturbations  of  the  state  space  operators.  Additive  perturbations  of  the 
plant  transfer  function  are  considered  first  in  order  to  apply  the  robustness  analysis 
developed  by  Jacobson  [47],  In  Section  3,  multiplicative  perturbations  will  be  con¬ 
sidered.  Multiplicative  perturbations  are  preferable  over  additive  since  compensated 
transfer  functions  (i.e.  GI\(s))  have  the  same  uncertainty  as  the  uncompensated 
plant,  and  multiplicative  perturbations  correspond  more  closely  to  the  classical  ideas 
that  lead  to  the  definition  of  gain  margin  and  phase  margin.  Section  3  will  apply 
the  sufficient  condition  for  robustness  developed  by  Chen  and  Desoer  [16]  which  is 
applicable  to  multiplicative  perturbations.  Section  4  will  then  extend  the  results  of 
Curtain  [22]  so  that  a  sufficient  condition  for  robust  finite-dimensional  controllers 
for  infinite-dimensional  plants  can  be  obtained.  The  approach  will  rely  on  II <*. 
techniques,  and  will  be  applicable  to  multiplicative  perturbations. 


6.2  LQG  Robustness 

The  LQG  design  will  yield  a  pair  of  operators  A'/  and  Kc  such  that  the 
nominal  system  can  be  stabilized  under  the  assumptions  that  (.4,2?)  and  (A.G)  are 
stabilizable,  and  (A,C)  and  (A.Q^2)  are  detectable.  The  closed-loop  system  with 
the  compensator  included  can  be  described  by  [47] 


Gci  =  CctTci{t)Bci 


where 


Gel  = 


0  -C 
Kc  0 


Bc,  = 


Kj  0 
0  B 


(181) 
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and  Tci(t)  is  the  semigroup  generated  by  the  operator 


Aci  = 


A  —  BKC  —  I\jC  —KjC 
BKC  A 


and  Td(t)  is  a  stable  semigroup  with  growth  constant  ui  =  max[uq,u)2],  where  uq 
and  u>2  are  the  growth  constants  associated  with  the  stable  semigroups  generated 
by  (.4  —  BKC)  and  (/l  —  KjC). 

The  closed-loop  system  will  remain  stable  in  the  presence  of  additive  perturba¬ 
tions  if  Ts(i)  is  a  stable  semigroup  (i.e.  if  Kc  and  Kj  stabilize  the  transfer  function 
of  the  perturbed  plant  as  well  as  the  nominal  plant  transfer  function). 


The  transfer  functions  Gnom  and  Gs  correspond  to  state-space  realizations 
{Anorn.  Bnorn.Cnom)  and  (Af.,  B^,C()  respectively.  The  triplet  describing  G6  is  not 
unique,  and  .4«i  does  not  equal  A.4  corresponding  to  a  perturbation  of  the  state-space 
operator  ,4  (and  similarly  for  B(  and  C$).  The  corresponding  state-space  equations 
are  given  by 


^nom  —  AnornXn0m  4"  BnomU 

y-nom  ~  Gnom^ttom 


(182) 

(183) 


and 


xs  =  AfX$  +  Btu 

(184) 

y6  =  C6xs 

(185) 

which  can  be  put  into  augmented  state-space  form  as 


%nom 

Anom  0 

% nom 

Bnom 

= 

+ 

is 

i - 

O 

i _ 

XS 

Bs 

2/nom  I  Cnpm  0  2 nom 


(186) 


Recall  that  the  compensator  is  based  on  the  nominal  plant  and  has  the  state- 
space  equations  given  by 

xc  —  {Anom  Bnomhc  l\jCnom  )xc  -f-  I\  jDp  (188) 

u  =  —Kcic  (189) 

Using  these  state-space  equations,  the  total  closed-loop  system  with  perturbations 
can  be  described  bv 


ic 

('^nom  BnornI\c  h  /("'nom)  ^  j^nom 

—  KjCt 

Ic 

f  nom 

- 

Bnom  ^  c  Anorn 

0 

^ nom 

is 

B*I\C  0 

At 

*6 

or  t  —  Aei  and 


Vp  Vt  “h  2/nom  [b  U'nom  ^  t 


IC 

X nom 
*6 


(190) 


(191 


Jacobson  [47]  shows  that  the  system  will  be  input-output  stable  (and  thus 
exponentially  stable)  if  Ae  generates  a  stable  semigroup.  If  At  is  the  generator  of  a 
stable  semigroup,  then  At  will  generate  a  stable  semigroup  whose  growth  constant 
is  determined  by  ||  KjCt  |j.  This  can  be  seen  by  writing  Af  as 


(192) 


(Anom  Bnom  ^  c  ^  J^nom) 

^  J^nom 

1  0 

0 

0 1 

-KjCt 

At  = 

Bnom  h  c 

Anom 

•  0 

+ 

0 

1  0 

-1 — 

0 

BSKC 

0 

1  A$ 

0 

°i 

0 

Proposition  4.7  of  Schumacher  [59]  provides  a  sufficient  condition  for  Ae  to 
generate  a  stable  semigroup.  The  following  proposition  is  Schumacher's  Proposition 
4.7. 


PROPOSITION  6.2.1:  Suppose  that  An  and  A22  are  generators  of  semi¬ 
groups  Tj(t)  and  7-2(1)  on  the  Banach  space  Ai  and  X2 ,  with  growth  constants  uq 


and  u >2  respectively.  Suppose  also  that  A21  :  A'j  — ►  A'2  is  a  bounded  linear  operator. 
Then  the  operator 


is  a  generator  of  a  Ca  semigroup  on  A'i  ®  A'2.  The  semigroup  has  a  growth  constant 
equal  to  maxp[ ,  u.-2]. 

Proof:  See  Schumacher  [59]  page  86. 

Since  the  upper  left  block  generates  a  stable  semigroup,  if  A$  generates  a 
stable  semigroup,  the  preceeding  proposition  states  that  the  first  matrix  term  in 
the  expression  for  Ae  generates  a  stable  semigroup  S(t).  Ae  will  generate  a  stable 
semigroup  if  ||  KjCf  ||<|  uj  |  where  u>  is  the  growth  constant  of  S(t).  Recall  that 
the  triplet  describing  Gj  is  not  unique,  so  that  it  may  be  possible  to  satisfy  these 
conditions  for  some  state-space  realizations  and  not  for  others. 

If  A 1  does  not  generate  a  stable  semigroup,  it  is  not  apparent  how  one  would 
determine  the  stability  of  the  semigroup  generated  by  Ae.  Thus,  if  one  wants  to 
express  perturbations  in  terms  of  transfer  functions,  it  is  not  clear  how  to  relate  the 
semigroup  factors  u>  and  M  to  robustness  unless  the  transfer  function  perturbations 
have  stable  generators,  which  is  a  restrictive  class.  Because  of  this,  one  may  wish  to 
consider  another  approach.  One  alternative  is  to  use  the  transfer  function  algebra 
discussed  in  Chapter  2.  Chen  and  Desoer  [16]  have  developed  a  set  of  necessary 
and  sufficient  conditions  for  robustness  for  not  only  additive  perturbations,  but 
multiplicative  perturbations  as  well  (a  preferred  model  for  perturbations).  The  next 
section  will  present  the  result  for  multiplicative  perturbations.  This  result  will  be  the 
basis  for  extending  the  work  of  Curtain  [22]  which  demonstrates  how  to  apply  H ^ 
techniques  to  the  problem,  and  derive  a  sufficient  condition  for  robustness  of  finite¬ 
dimensional  controllers  in  the  presence  of  multiplicative  perturbations.  Curtain  [22] 


Figure  5.  Unity  Feedback  Control  System 

has  developed  sufficient  conditions  for  robustness  for  additive  perturbations  using 
an  approach.  This  research  will  extend  that  work  in  order  to  consider  not 
only  additive  perturbations,  but  multiplicative  perturbations  of  the  plant  transfer 
function  as  well. 

6.3  Robustness  Sufficient  Condition 

Consider  the  configuration  shown  in  Figure  5.  This  is  the  configuration 
used  by  Jacobson  [47]  in  his  work.  In  Figure  5,  P  is  the  plant  to  be  controlled, 
and  A  is  the  compensator.  Ignoring  disturbances,  let  u2  =  0.  Jacobson  has  proven 
that,  for  systems  satisfying  the  assumptions  of  Chapter  1,  the  transfer  function  P(s) 
belongs  to  the  algebra  B(a)  described  in  Definition  2.5.5  of  Chapter  2.  Specifically, 
the  following  theorem  applies: 

THEOREM  6.3.1:  If  the  system  described  by 

x  =  Ax  +  Bu  x(0)  €  D(A ) 
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satisfies  the  assumptions  in  Section  3  of  Chapter  1  on  ( A,B,C ),  and  if  the  system 
is  both  exponentially  stabilizable  and  detectable,  then  the  transfer  function  P{s )  = 
C(sl  —  A)~lB  has  a  representation  in  B(c)nTn  for  some  a  <  0. 

Proof:  See  Jacobson  [47]  page  14. 

The  fact  that  P(s)  has  a  representation  in  B{a)  will  be  important  to  the 
development  of  the  necessary  and  sufficient  conditions  for  robustness.  Note  that  the 
stochastic  system  of  equations  is  given  by 

j  =  Ax  +  Bu  +  Gw  (193) 

y  =  Cx  +  t?  (194) 

However,  the  Gw  and  t)  noise  terms  do  not  alter  the  transfer  function  mapping  P  : 
u  — *  y.  Thus,  the  plant  input-output  transfer  function  for  the  stochastic  equations 
is  the  same  as  for  the  equations  in  Theorem  6.3.1.  Therefore,  by  Theorem  6.3.1,  the 
plant  transfer  function  P(s)  =  C(sl  —  A)~lB  is  in  the  algebra  B(a)nxn  for  some 
<7  <  0.  Jacobson's  proof  of  Theorem  6.3.1  also  shows  that  the  compensator  transfer 
function  must  lie  in  B(a)nzn  for  some  a  <  0.  This  idea  is  also  contained  in  a  theorem 
by  Nett  [53]. 

THEOREM  6.3.2:  If  P  €  B(a)nzn,  and  if  K  is  a  Laplace  transformable 
distribution  which  A. (a)  stabilizes  (input-output  stable,  see  Definitions  2.5.2  and 
2.5.6)  the  closed-loop  system,  and  if  either  PK  or  KP  is  proper,  then  both  P  and 
1\  have  entries  in  B(a)nTn . 


A  distribution  is  a  linear  continuous  functional  defined  on  the  space  of  con¬ 
tinuous  functions  which  have  continuous  derivatives  of  all  orders,  and  which  vanish 
outside  some  closed  and  bounded  region  (see  [37]  for  details). 

Proof:  See  Nett  [53]  pg  56. 

Thus,  since  P  can  be  assumed  to  be  strictly  proper  (valid  assumption  since 
the  frequency  response  of  any  physical  system  is  bandlimited)  then  one  has  that 
A  G  B{a)nxn.  Also,  if  K  =  1\  (the  finite-dimensional  stabilizing  controller),  then 
clearly  K  G  B{a)nxn. 

At  this  point  the  only  measures  of  stability  robustness  have  been  the  mag¬ 
nitude  of  the  exponential  time  constant,  the  magnitude  of  the  semigroup  bound 
constant,  or  the  operator  fi  for  the  O.P.E.  approach.  However,  it  is  hard  to  re¬ 
late  model  uncertainties  to  the  exponential  factor  u\  A  measure  of  robustness  that 
has  been  used  in  the  design  of  finite-dimensional  control  systems  [30,  32,  35]  is  the 
singular  value. 

Let  A  G  Cnxn  (where  Cnxn  is  the  ring  of  square  matrices  with  elements  in  C). 
A  ring  is  a  set  on  which  the  operations  addition  and  multiplication  are  defined, 
and  multiplication  is  distributive  over  addition.  The  largest  singular  value  of  A  is 
defined  to  be  [63] 

CTmarl 4]  =  SUp  ||  Az  ||  (195) 

11*11=1 

which  is  just  the  £2  norm  of  A.  The  algebraic  properties  of  B(a)  places  the  loop 
gain  operator  PK(I  +  PK)~l  in  this  ring,  so  that  one  can  define  its  largest  singular 
value.  Since  for  each  u  G  3R+ 

[PK{I  +  PK)-'(ju)]  €  Cnxn 

then  omax{\PK{l  +  PJ\)~'(juj)]}  is  defined.  This  will  allow  the  singular  value  to 
be  used  as  measure  of  robustness  for  the  systems  considered  in  this  research. 


Figure  6.  Feedback  Control  System 


One  can  put  the  LQG  problem  into  the  setup  of  Figure  6  by  defining 


P  =  C(sl  -  A)~'B  (196) 

K  =  Kc{sl  -  A  +  BKC  +  KjCT'Kj  (197) 

F=I  (198) 

U2  =  Gw  U3  =  T)  (199) 


Unity  feedback  is  used  in  order  to  correspond  to  the  development  in  Chapter  2.  Since 
F  =  /,  then  F  (E  B{a)nzn .  This  will  be  needed  in  development  of  the  robustness 
conditions.  U]  is  the  command  input  to  the  system.  One  may  also  consider  u2  as 
an  added  input  to  the  plant  as  well  as  a  disturbance.  This  system  will  be  denoted 
as  S(P,  A',F). 

Now,  consider  multiplicative  perturbations  since  the  compensated  plant  has 
the  same  uncertainty  associated  with  it  as  the  nominal  plant  [30],  and  since  they 
correspond  more  closely  to  the  classical  ideas  of  gain  and  phase  margins.  Hence, 
the  perturbed  plant  P  will  be  defined  as  P  =  (/  +  Mp)P,  where  A/p  is  an  element 
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of  a  class  of  perturbations.  The  properties  of  the  perturbations  will  be  outlined  in 
the  last  theorem  of  this  section.  The  perturbed  closed-loop  system  is  referred  to 
as  S(P,  K,  F).  Recall  the  definition  of  A-.(cr)  stability  found  in  Definition  2.5.6. 
A. (a)  stability  is  the  same  as  input-output  stability.  Jacobson’s  work  [47]  provides 
the  following  theorem: 


THEOREM  6.3.3:  If  the  system  is  exponentially  stable,  then  it  is  A-(a) 


stable  for  some  a  <  0. 


Proof:  See  Jacobson  [47]  pg  43. 


Thus,  since  the  compensator  I\  exponentially  stabilizes  the  closed-loop  system, 
the  nominal  closed-loop  system  is  A_(o)  stable  for  some  a  <  0.  The  question 
is,  under  what  conditions  will  the  closed-loop  system  remain  A_(cr)  stable  in  the 
presence  of  multiplicative  perturbations?  Chen  and  Desoer  [16]  give  necessary  and 
sufficient  conditions  for  the  robust  stability  of  S(P,  A',  F).  In  the  theorem  to  follow, 
lm  is  a  scalar  function  that  describes  the  uncertainty  of  the  system  as  a  function 
of  frequency,  and  np+  denotes  the  number  of  poles  of  the  plant  P  in  the  right  half 
plane.  The  backslash  notation  used  to  define  the  perturbations  Mp  (i.e.  .4_(cr)\{0}) 


means  exclusion  of  the  zero  vector. 


THEOREM  6.3.4:  Consider  the  multiplicatively  perturbed  system 
S(P,  1<,F)  with  P  =  (/  +  Mp)P.  Let  P  £  B(o)nxn  ,  K  £  B{a)nxn,  and  F  £  B{c)r 
for  some  a  <  0.  Also,  let  Mp  £  M  where 


M  =  (A/,  :  A/p  e  H-(»)] .  [A-(<t)\{0}]-'; 


A/pP  €  fllo)""; 


np+  —  tip+ 


>  V  V  V  V  V  V  V  V  V 


www 


<ymaz[Mp{ju;)\  <  /mM  v^efc+) 


Under  these  conditions,  if  S(P,K,F)  is  A-{o)  stable,  then  VA/P  €  M , 
5(P,A',JP)  is  A-(«r)  stable  if  and  only  if 

amaT[PKF(l  +  PKF)-\ju!)]  <  lm( u;)-1  6 


Proof:  See  Chen  and  Desoer  [16]  pg  264. 

The  size  restriction  imposed  by  the  “tolerance”  function  lm  on  A/p  implies 
that  the  perturbation  has  no  poles  on  the  ju^-axis.  This,  with  the  condition  on 
the  number  of  poles  of  the  perturbed  system,  implies  that  the  perturbations  do  not 
introduce  additional  right  half  plane  poles.  The  function  lm  in  essence  defines  the 
size  of  the  “ball  of  uncertainty”  around  the  nominal  plant  P,  such  that  stability  is 
retained,  by  defining  how  large  A/p  (and  therefore  MpP)  can  be.  For  a  discussion  of 
lm( ~).  the  reader  is  referred  to  [30]. 

Note  that: 

i)  The  description  of  M  implies  that  Mp  £  M.  may  not  be  proper,  but  both 
P  and  P  must  be  strictly  proper  in  order  for  MpP  €  P(er),  which  is  assumed.  As 
pointed  out  earlier,  this  is  not  felt  to  be  restrictive  since  the  frequency  response  of 
any  physical  system  is  bandlimited. 

ii)  The  description  of  M.  tells  one  that  all  elements  M  must  belong  to  the 
field  of  fractions  of  the  commutative  domain  A_(a)  (the  algebra  A_(< 7)  forms  the 
domain  of  the  field,  and  multiplication  on  this  algebra  commutes).  This  is  needed 
in  order  to  make  the  proof  work. 

iii)  n^4  is  the  number  of  right-half  plane  poles  of  P.  Thus,  it  is  assumed  that 
the  number  of  unstable  poles  of  P  is  the  same  as  for  P  (i.e.  the  unstable  poles  of 
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P  are  obtained  by  moving  around  the  unstable  poles  of  P).  This  is  needed  in  the 
proof  so  that  stability  of  the  nominal  system  will  imply  stability  of  the  perturbed 
system. 


Theorem  6.3.4  gives  a  singular  value  measure  of  stability  robustness  for  dis¬ 
tributed  parameter  systems,  and  it  will  have  the  same  type  of  conservatism  as  dis¬ 
cussed  in  [30].  Since  the  singular  value  is  not  structured,  it  assumes  a  worst  case 
bound  for  the  perturbation  for  all  channels  in  a  MIMO  system.  This  leads  to  con¬ 
servatism  in  the  design.  This  procedure  gives  a  way  to  check  sufficient  conditions 
for  robustness  of  the  closed-loop  system. 

Based  on  the  work  of  Curtain  [22],  this  measure  of  robustness  can  be  used 
in  conjunction  with  //«,  techniques  (the  norm  used  to  define  the  largest  singular 
value  is  the  //^  norm)  to  give  a  design  tool  by  which  a  finite-dimensional  controller 
can  be  evaluated  for  robustness.  The  next  section’s  results  are  a  direct  consequence 
of  Theorem  6.3.4  and  Curtain’s  results  [22]  for  additive  perturbations.  However, 
since  Curtain  only  considered  additive  perturbations,  the  material  in  Section  4  is 
presented  in  order  to  extend  her  work  to  multiplicative  perturbations,  which  arc 
preferred. 

6.4  H oc  Approach 

Extending  Curtain’s  results  [22]  to  consider  multiplicative  perturbations 
follows  directly  from  her  work  and  that  of  [16].  However,  it  is  very  useful  to  accom¬ 
plish  since  multiplicative  perturbations  more  accurately  reflect  simultaneous  gain 
and  phase  change  in  a  system. 

The  desire  is  to  stabilize  a  family  of  plants  described  by  the  transfer  function 

G(s)  =  (/  +  A/p)Gnom(s)  (200) 

using  a  finite-dimensional  LQG  based  compensator  which  has  the  transfer  function 

K(s)  =  Kc(sl  -  A  +  BKC  +  KjCy'Kj  (201) 


a 


Figure  7.  System  with  Multiplicative  Perturbations 


r. 

/■; 

«■/ 


The  problem  corresponds  to  the  block  diagram  of  Figure  7  which  is  equivalent 
to  Figure  6  with  F  =  1  and  P  =  G.. 

To  correspond  with  the  definition  of  exponential  stability,  a  of  the  algebra 
B(o )  will  be  chosen  to  be  zero.  The  following  assumptions  will  be  needed  in  order 
to  use  the  results  of  [22]  and  [16]. 


1.  A lpG(s)  €  B(0)nTn  where  B(0)nrn  is  the  Banach  algebra  developed  by  Callier 
and  Desoer  [27,  12,  13,  14,  15,  26],  and  defined  in  Section  5  of  Chapter  2. 

2.  G(s)  and  G(s)  have  the  same  number  of  poles  in  C+  (the  right  half  of  the 
complex  plane). 

3.  G(s)  €  B(0)nxn  with  no  poles  on  the  jut  axis. 

4.  ||  Mp(u>)  Hoc  <  fm{u))  where  /m(u>)  is  a  scalar  function  of  u>. 

5.  K(s)  6  B{ 0)n,n 
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These  assumptions  are  needed  in  order  to  apply  the  results  of  Chen  and  Des- 
oer  [16],  and  are  the  same  ones  made  by  them  in  Theorem  6.3.4  [16].  The  discussion 
of  the  assumptions  following  Theorem  6.3.4  applies  here  also.  Assumption  3  and  4 
allow  one  to  use  results  found  in  [12,  13]  to  express  the  perturbed  transfer  function 
as  the  sum  of  a  rational  transfer  function  and  a  stable  irrational  transfer  function. 
This  will  be  stated  more  precisely  later,  and  is  essential  to  the  development.  As¬ 
sumptions  1  and  5  are  made  in  order  to  apply  the  algebraic  properties  of  the  Banach 
algebra  B(cr)nTn .  Assumption  2  says  simply  that  the  perturbations  do  not  introduce 
additional  right  half  plane  poles,  and  allows  one  to  conclude  stability  of  the  per¬ 
turbed  system  when  the  nominal  system  is  stabilized.  Notice  that  assumption  4  can 
be  equivalently  expressed  as 

||/;,A/P)U<  1  (202) 

where  the  oc  norm  is  defined  as 

||  *  ||oc=  supermar[*(s)]  =  ess  sup  omor  [*(>;)]  (203) 

u> 

The  small  gain  theorem  as  found  in  [71]  gives  a  sufficient  condition  input- 
output  stability  (i.e.  a  bounded  input  produces  a  bounded  output).  The  open  loop 
gain  is  the  operator  which  maps  the  input  to  the  compensator  A',  to  the  output  of 
the  feedback,  and  is  obtained  by  opening  the  feedback  loop  in  Figure  7  just  to  the 
left  of  the  block  labeled  K(s). 

THEOREM  6.4.1:  Let  the  feedback  system  be  described  by  the  block  dia¬ 
gram  of  Figure  7.  The  system  will  be  input-output  stable  if  the  open  loop  gain  is 
less  than  unity. 


Proof:  See  Zames  [71]  page  232. 


For  the  system  of  Figure  7,  one  can  perform  the  block  diagram  transformations 
as  shown  in  [33,  34]  and  express  the  small  gain  sufficient  conditions  as 

||  M„GK{I -GK)~l  lU  <  1  (204) 

In  view  of  Equation  (202),  a  sufficient  condition  for  Equation  (204)  to  be  satisfied 
is 

||  fmGK(I  -  GA')"1  IU  <  1  (205) 

which  can  be  equivalently  expressed  as 

||  GK(I  -  GK)~'  lU  <  /-1  =  ||  Wx  |U  (206) 

Francis  and  Curtain  [34,  22]  refer  to  U'j  as  a  sensitivity  function.  VF,  is  any  stable 
rational  transfer  function  for  which  1 1 1 ^ 'i 1 1 oo  =  and  for  which  VF,-1  is  also  a 
stable  rational  transfer  function.  Notice  that  assumption  4  can  be  expressed  in 
terms  of  IF,  as 

||  IF, A/p  lU  <  1  (207) 

Curtain’s  development  [22]  is  formulated  in  terms  of  two  senitivity  functions. 
IF,  and  IF2,  were  U2  is  also  a  stable  rational  transfer  function.  The  assumption 
she  imposes  is  that  ||IFj A/plF2||oo  <  e  where  t  is  a  positive  scalar.  Following  her 
notation  and  development  ,  c  has  been  set  equal  to  1,  and  IF2  =  VF2“  =  1. 

The  nominal  feedback  system  is  obtained  by  setting  A/p  =  0.  It  is  assumed 
that  a  compensator  has  been  chosen  that  stabilizes  the  nominal  system  so  that  the 
nominal  system  is  v4_(0)  stable  as  defined  in  Chapter  2,  Section  2.5.  Thus,  as  shown 
in  [16],  the  operators  (I  —  Gl\  )“*,  K{1  —  GA')_1,(/  —  GK)~1G ,  and 
[1  ~  K ( 1  —  G K)~l  G]  are  all  elements  of  the  algebra  of  transfer  functions  >4_(0).  These 
facts  allow  one  to  manipulate  these  operators  algebraically,  and  apply  standard  block 
diagram  type  arguments. 


j 
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The  following  definition  is  taken  from  Curtain  [22].  In  the  definition,  the 
triplet  notation  is  used  to  denote  the  feedback  system  of  Figure  7  with  perturbations 
described  by  the  sensitivity  function  W'j. 


Definition  6.4.1:  The  feedback  system  denoted  by  the  triplet  (G,  \\\,K)  will 
be  called  robustly  stable  if  and  only  if  ( G  +  A/PG,  K)  is  input-output  stable  for  all 


perturbations  MPG  6  B(0)nIn  satisfying  assumption  2  and  ||  \\\MP  ||oc<  1. 


As  a  result  of  this  definiton,  a  system  is  robustly  stabilizable  if  there  exists  a 
compensator  A  €  B( 0)nrri  such  that  (G,  Wt,K)  is  robustly  stable.  Since  IV,  £  9R// °° 
(the  class  of  stable  rational  transfer  functions),  then  the  fact  that  G  £  B(0)nTn  with 
no  poles  on  the  imaginary  axis  along  with  the  condition  of  Equation  (207)  yields 
[12]  that 

h  i G  =  Gi  -f  Gj  (208) 


Note  that  Gt  is  the  finite-dimensional  unstable  part  of  the  system,  and  Gj  denotes 
the  complex  conjugate  transpose  of  the  transfer  function  matrix  Gj.  In  other  words, 
for  the  rational  transfer  function  Gi(s),Gj(s)  =  [G(— s)]*.  Also,  G2  £  A_(0)  (sta¬ 
ble  infinite-dimensional  part)  and  Gj  €  3?//°°  (the  class  of  rational  stable  transfer 
functions)  with  Gi(oc)  =  0  (rational  transfer  function  with  poles  in  C+). 


In  Curtain's  development  [22],  she  shows  that  the  system  is  robustly  stable  to 
additive  perturbations  if  the  finite-dimensional  transfer  function  Gi  can  be  robustly- 
stabilized.  Similar  results  will  be  obtained  for  the  case  of  multiplicative  perturba¬ 
tions  by  following  the  lemmas  in  her  work.  As  in  her  work,  one  can  write  a  version 
of  Chen  and  Desoer’s  corollary  (see  [16]  page  264)  to  yield 


LEMMA  6.4.2:  Under  assumptions  1  thru  5  on  page  108,  (G,  Hj,A)  is 
robustly  stable  if  and  only  if  (G,K)  is  stable  under  nominal  conditions  and 


GA  (7  -  GA')'1M  j'1  ||oo<  1 


Proof:  See  Chen  and  Desoer  [16]  page  264. 


This  then  leads  to  the  next  Lemma. 

LEMMA  6.4.3:  Under  assumptions  1  thru  5,  there  exists  a  compensator 
€  •B(0)n-rT1  such  that  (G ,\\\,  K)  is  robustly  stable  if  and  only  if 

K  =  (I  +  KlG2)-'Kl\Vl 

for  some  A,  6  B(0)nrn  such  that  (Gj.H’j.A',)  is  robustly  stable. 

Proof:  Following  the  proof  in  Curtain  [22],  since  W',  and  W’f1  £  ?RH oc,  a 
block  diagram  type  of  argument  corresponding  to  Figure  7  will  suffice.  (G,\\\,I<) 
is  robustly  stable  if 

||  GK(]  -  GK)~'\V-'  !!«<  l 

But.  as  shown  by  Curtain,  this  is  true  if  and  only  if 

II  U'jGA'tr-V-  U'.CA'U'-’r’U--1  11^ <  ] 
or  equivalently  (B',G,  IT,,  A'lVf1)  is  robustly  stable. 

Now,  one  can  write  \\\G  =  Gi  +  G2  so  that  (G,  +  G2 ,  \\\,  A'W'f1)  is  robustly 
stable.  Let  I\2  =  All  ,  so  that  (Gj  +  G2,  Wi,A2)  is  robustly  stable.  As  shown  in 
Doyle  and  Francis  [34],  this  equivalent  to  (G, ,  W\ ,  A'2(7  -  G2I<2)~1)  being  robustly 
stable. 

Let  Ai  =  A2(7  -  G2A2)_1  so  that  (GuWi,h\)  is  robustly  stable.  Note  that 
K2  =  K1(l  -  GK2)  =  A',  -  K1GK2 


or  equivalently 


h  \  —  h2  h\G2K2  =  (/  +  KxG2)K2 


so  that  h'2  =  (/  +  A',C?2)  *A',  or 

A'  =  (/  + A'jGjr’A'.ir, 

The  fact  that  K  G  5(0)  if  and  only  if  h\  G  5(0)  follows  from  this  last  equation 
since  Gj  G  A-(o).  Q.E.D. 

Lemma  G.4.3  says  that  the  total  system  is  robust  if  and  only  if  the  finite¬ 
dimensional  unstable  part  of  the  transfer  function  is  robustly  stable  with  h\  and  if 
K  has  the  specified  form.  One  can  use  this  to  yield  the  following  corollary. 

COROLLARY  6.4. 4:  (G,  H’j,  A')  is  robustly  stable  if  and  only  if 
inf  ||  G,A'i(7  -  G1A',)-1iri_1  |U<  1 

A  1 


Proof:  This  is  an  immediate  consequence  of  combining  Lemma  6.4.2  and 
Lemma  6.4.3.  Q.E.D. 

At  this  point,  when  multiplicative  perturbations  are  considered,  a  way  to  de¬ 
termine  robustness  of  the  system  using  a  finite-dimensional  compensator  is  available. 
Let  K  be  the  approximation  of  1\  obtained,  say,  using  Schumacher's  technique.  Then 
for  a  sufficiently  high  order  approximation,  the  nominal  system  is  input-output  sta¬ 
ble.  The  question  one  has  to  ask  is,  how  robust  is  the  controlled  system  using  this 
choice  of  A  ?  Corollary  6.4.4  gives  a  sufficient  condition  for  A  to  satisfy  that  will 
ensure  stability  of  the  perturbed  system. 

Let  G i  be  the  part  of  the  plant  transfer  function  corresponding  to  the  finite¬ 
dimensional  unstable  space.  Then  (Gi,H’i)  is  robustly  stabilizable  if  and  only  if 


Gi  A",  ( /  —  G1  A'i  )-1  W'j-1  ||oo<  1 


(209) 


and,  as  given  in  Lemma  6.4.3, 


A',  =  A'U'j-1(/  -  GjA'ir-1)-1  (210) 

with  G 2  =  G\G i,  where  the  backslash  notation  is  used  to  denote  the  exclusion  of 

the  operator  G i . 

Thus,  given  an  approximation  A’,  a  sensitivity  function  Vl  j,  and  a  nominal 
plant  transfer  function  G  (and  thus  G\  and  G2).  one  can  solve  for  J\\  and  then 
determine  if  G'i  is  robustly  stabilized  with  respect  to  Hj.  If  this  occurs,  then  since 

A'  =  A',(7  -  G2K\V-')\\\  (211) 

which  equates  to 

A  =  (/  +  A'.^r’A.H-,  (212) 

Lemma  6.4.3  yields  that  the  total  system  will  be  robustly  stable  using  this  choice  of 
A  .  Hence,  one  can  reduce  the  robustness  issue  to  a  singular  value  test  by  applying 
Lemma  6.4.3. 

One  thing  to  note  is  that  A’s  robustness  properties  will  be  directly  related  to 
the  properties  of  the  compensator  A'  it  is  approximating.  In  a  way  just  like  that 
described  for  A',  the  robustness  of  K  should  be  evaluated.  One  should  not  expect 
to  get  good  robustness  with  K  if  A  does  not  have  good  robustness.  Assuming  I\ 
has  desirable  robustness  properties,  it  is  not  clear  whether  one  should  improve  A*’s 
robustness,  or  the  approximation  A\  when  K  is  not  robust  enough. 

Also,  this  approach  allows  one  to  leave  the  sensitivity  function  undefined, 
and  solve  for  it,  given  G  and  I\.  In  this  way  one  may  be  able  to  evaluate  the 
robustness  of  one  design  versus  another,  and  therefore  get  some  idea  as  to  when  an 
approximation  is  good  enough.  An  approximation  I\  can  be  considered  acceptable 
when  it  satisfies  the  condition  of  Equation  (209)  for  a  desired  H  j . 

In  a  way  like  that  used  by  Sandell  [57],  one  can  also  develop,  sufficient  con¬ 
ditions  which  may  have  more  physical  meaning.  Using  the  following  sufficient  con- 


dition  allows  one  to  leave  the  sensitivity  function  VT,  undefined,  and  determine  a 
conservative  estimate  of  the  system's  robustness  for  a  given  G  and  K .  Thus,  if  one 
does  not  have  a  good  idea  of  what  type  of  perturbations  to  expect,  the  following 
condition  yields  a  conservative  measure  of  the  perturbations  a  system  can  accept 
and  remain  stable. 

LEMMA  6.4.5:  Let  It’,  be  a  sensitivity  function  describing  the  uncertainty 
of  a  system.  A  sufficient  condition  for  the  sytem  to  be  robustly  stable  is 


H'f1  IU< 


[7  -  (7  +  GA) 


Proof  This  condition  implies  that 


which  implies  that 


The  identic 


[/-(/  + GAT1]  lull  u7l  IU<  1 


(7  -  (/  +  GA)“,]lt'1_1  |U<  1 


/-(/-+-  GA  )-1  =  GI\(1  +  GA)_I 


can  be  substituted  into  the  second  inequality  to  yield 


GK(I  +  GK)-1\Vl~l  IU<  1 


and  Lemma  G.4.3  gives  the  desired  resu  It.  Q.E.D. 


In  this  development,  the  sensitivity  function  W2  of  Curtain’s  development 
[22]  has  been  chosen  to  be  the  identity  operator  and  W,  was  the  only  sensitivity 
function  considered.  This  seems  reasonable  since  many  examples  [22,  33]  choose 
M  2  =  /•  However,  as  shown  in  Francis  [33,  34],  one  may  wish  to  let  W2  be  a  second 


sensitivity  function  in  order  to  describe  the  structure  of  the  perturbations  more 
accurately.  For  example,  one  may  want  to  model  uncertainty  at  two  points  in  the 
system.  Using  two  sensitivity  functions  instead  of  one  may  allow  one  to  do  that. 
This  research  will  not  consider  this  since  many  of  the  examples  in  the  literature 
have  not,  and  also,  to  do  so  is  a  simple  extension  of  this  work. 

The  disadvantage  of  using  methods  is  the  difficulty  to  solve  the  associated 
equations  for  MIMO  systems  other  than  delay  equations.  However,  it  is  the  only 
method  developed  in  this  research  that  allows  one  to  consider  perturbations  of  the 
transfer  function  directly.  The  other  methods  involve  modeling  perturbations  as 
changes  to  the  state  space  operators.  It  may  be  difficult  to  do  that  if  one  only  has 
input-output  responses  to  describe  a  system.  It  is  difficult  to  relate  perturbations 
of  a  transfer  function  to  a  triplet  of  operator  perturbations  (AA,  AB,  AC). 

6.5  Summary 

This  chapter  began  by  analyzing  the  robustness  of  a  system  controlled 
by  a  LQG  controller,  assuming  additive  perturbations  to  the  plant  transfer  function. 
Only  for  the  case  of  stable  perturbations  could  stability  of  the  closed-loop  system  be 
determined  using  direct  analysis  methods.  Section  6.3  used  the  algebra  of  transfer 
functions  discussed  in  Chapter  2,  and  presented  a  necessary  and  sufficient  condition 
for  robustness  for  the  case  of  multiplicative  perturbations  of  the  plant  transfer  func¬ 
tion.  Since  multiplicative  perturbations  are  usually  perferred,  this  result  is  quite 
useful. 

Using  this  result,  along  w’ith  the  work  by  Curtain  [22],  Section  6.4  developed 
a  sufficient  condition  for  robustness  using  techniques.  Theorem  6.4.2  provides 
a  condition  for  robustness  of  the  infinite-dimensional  LQG  controller  when  multi¬ 
plicative  perturbations  are  considered.  From  this,  Corollary  6.4.4  is  developed  which 
yields  a  sufficient  condition  for  robustness  based  on  the  finite-dimensional  controller 
and  am  infinite-dimensional  plant.  An  alternative  sufficient  condition  is  presented 


in  Lemma  6.4.5.  These  sufficient  conditions  can  be  used  as  a  measure  of  the  finite¬ 
dimensional  controller's  robustness  by  leaving  the  sensitivity  function  undefined 
or  they  can  be  used  to  determine  when  a  controller  is  acceptable  when  W'j  is  defined 

The  next  chapter  is  an  application  of  the  techniques  developed  in  this  research 
Some  of  the  advantages  and  disadvantages  of  the  approaches  are  discussed. 


VII.  Application  Example 


7.1  Introduction 

This  chapter  contains  a  simple  example  that  will  demonstrate  the  ap¬ 
plication  of  the  techniques  developed  in  this  research.  The  equation  considered  is 
a  parabolic  partial  differential  equation  that  describes  the  temperature  distribution 
on  an  isolated  uniform  rod  (i.e.,  it  is  a  heat  equation).  The  problem  is  not  in¬ 
tended  to  be  realistic,  but  rather  is  chosen  so  that  solutions  can  be  obtained  and 
the  techniques  applied  without  losing  readers  in  the  mathematical  details.  Since  a 
good  design  depends  on  many  engineering  factors,  no  attempt  is  made  to  get  a  best 
design.  This  problem  is  the  same  type  as  the  one  in  Chapter  3  with  the  exception 
that  the  A  operator  has  been  changed  in  order  to  have  two  unstable  eigenvalues. 

7.2  Problem 

Let  the  problem  be  given  by 

d  Id2 

-x(z,t)  =  (——  +  4)i(zj)  +  lu(t)  +  lw(1)  t>0;0<z<\  (213) 

with  Dirichlet  boundary  conditions 

x(0,t)  =  x(l,t)  =  0  Vi  >  0 

and  initial  condition 

x(r,  0)  =  0  V*€[0,1] 

Assume  a  scalar  input  (u  €  3R1)  and  a  scalar  output  given  by 

y{ 0  =  /  x(z,t)dz  +  T ]{t)  (214) 

with  »7(t)  £  3?  Vi  (i.e.  real  valued).  The  state  space  will  be  H  =  L2(0, 1)  and 
choose  the  strengths  of  the  white  Gaussian,  zero-mean  noise  terms  w  and  r?  to  be 


Qo  =  1  and  Rj  =  Inxn  respectively.  As  before,  these  choices  are  made  to  simplify 
the  solution  so  that  numerical  results  can  be  obtained. 

The  domain  of  the  operator  A  is  defined  by 

D{A)  =  {x  £  W  |  €  W;x(0)  =  x(l)  =  0}  (215) 

where  A  has  been  changed  from  the  example  in  Chapter  3  in  order  to  have  two 
unstable  eigenvalues,  and  the  operator  A  satisfies 

i  a2 

Ax  =  (  —  —  +  4)x  Vx  £  D{A)  (21G) 

n*  azl 

The  output  mapping  C  is  given  by 

Cx  =  /  x(z,t)dz  Vt  £  H  (217) 

Jo 

which  can  be  written  in  inner  product  notation  as 

Cx  =  (l,x)  (218) 

which  is  simply  the  inner  product  of  the  function  which  is  1  everywhere  with  elements 
in  the  Hilbert  space  H  as  defined  by  Equation  (217).  It  is  assumed  that  the  output 
vector  y  is  to  be  controlled,  and  Qc  is  then  chosen  to  be  C’C . 

Schumacher  [59]  shows  that  the  operator  A  generates  an  analytic  semigroup  for 
t  >  0,  and  A  has  a  discrete  spectrum  with  simple  eigenvalues  at  4  —  i2  ( *  =  1,2,...) 
with  corresponding  eigenfunctions  given  by 

<f>,  =  v^sin  inz  (219) 

which  is  a  complete  orthonormal  set  in  L2(0, 1).  Because  of  the  simple  form  of  B,G. 
and  Q0,  Schumacher  shows  that  (A,B)  and  (A,G)  are  stabilizable,  and  (A,C)  and 
( A,Qa )  are  detectable  [59], 

Following  the  same  development  found  in  Chapter  3,  one  can  design  a  steady 
state  constant  gain  LQ  controller  assuming  full  state  access  as  shown  in  Matson 


v  - -v>.  v  v  .-. v  vv  v  v  /■  ->  v v> n*.-u<  v 


[51].  This  yields  for  the  regulator  gain  operator 

Kc  =  R~'  BmPc  (220) 

Let  Rc  =  /"*"  (again  to  aid  in  obtaining  a  solution),  so  that  Kc  =  Pc  where  Pc 
satisfies  the  Riccati  equation 


( — 2  a; 2  +  8)p„  +  1  =  p2%x 


(224) 


Using  this  fact  then  yields 

Peh  =  £>„  <  M.  >  4>,  =  Kch  (225) 

>=i 

In  a  similar  way  one  finds  that  the  steady  state  Kalman  filter  constant  gain 
operator  is  given  by 

Ks  =  PjC'R?  (226) 

where  Pj  satisfies  the  Riccati  equation 

<  A’h,Pjk  >  +  <  Pjh,  A'k  >  +  <Qjh,k>  =  <  PjCmR]'CPfh ,  k  > 

Vh,k£D{Am)  (227) 

where  for  this  problem  Am  =  A  and  Qj  is  given  by 

Qjh  =  GQoG’h  =  Q0h  Vh£H  (228) 


For  this  example  Qa  =  /  =  Qj  in  order  to  make  obtaining  a  solution  easier.  Also 
by  duality,  Pj  can  be  written  as 

Pjh  =  jrjrq,J<h,4>,><t>J  (229) 

.=1 J=1 

With  Qj  =  I  and  Rj  =  lnxn  (so  that  a  solution  can  be  obtained),  the  q,/s  can  be 
found  from  the  equation 

(— 2i2  +  8)q„  +  1  =  g2  (230) 

and  the  operator  1\  j  can  be  written  as 

OC 

Kjh  =  ^2  q„  <  h,<f>,  >  <t>,  (231) 

i=i 

In  order  to  apply  Schumacher's  approximation  technique,  one  must  determine 
if  the  eigenfunctions  of  ( A  —  BKC)  are  complete.  As  was  demonstrated  in  Chapter 
3,  this  is  the  case.  This  problem  differs  from  the  one  in  Chapter  3  in  that  there  are 
two  unstable  eigenvalues  associated  with  this  problem.  Both  of  these  eigenvalues 
must  be  shifted  to  the  left  half  plane  in  order  to  stabilize  the  system. 

Using  the  quadratic  formula,  one  can  solve  for  p„  and  g„  as  given  by 


which  for  this  example  gives 

qu  =  6.16  =  pj  j 
922  =  1  =  P  22 
933  =  .1  =  p33 

and  so  forth.  The  resulting  regulator  poles  will  be  the  spectrum  of  the  operator 
(A  —  BKC)  which  is  given  by 


a(A  -  BKC)  =  X,  -  q„  i  =  1,2,... 


(233) 


and  the  filter  poles  will  be  the  spectrum  of  the  operator  {A  —  A/C)  which  is  given 


cr(A  —  KjC)  =  A,  —  p„  i  =  l,2,.. 


(23-1) 


The  amount  of  spectrum  shift  that  occurs  is  a  function  of  the  operators  Kc  and  A'/, 
which  are  determined  by  the  A.R.E.s  and  therefore  are  a  function  of  the  operators 
Rj ,  /?-.  Q f,  Qc .  C,  B ,  and  (V 


7.5  Schumacher's  Approach 


The  purpose  of  this  example  is  to  illustrate  the  application  of  the  tech¬ 
niques  developed  and  explored  in  this  research  effort.  The  first  technique  to  be 
considered  will  be  that  of  Schumacher  (58,  59,  60].  One  can  choose  the  isomorphism 
R  of  Theorem  3.3.1  to  be  a  projection  operator  that  maps  the  Hilbert  space  'H  to  a 


finite-dimensional  subspace  "Hk  so  that 


Kf  =  RI\j  =  PkKj  :  v 


Ke  =  KeR~'  =  A,  (AT 1  :  Kk  -»  3* 


(236) 


Let  the  order  of  the  subspace  be  k  =  2  and  select  the  finite-dimensional  subspace 
so  that  7 Hk  =  'Hu  where  Tiu  is  the  unstable  subspace  spanned  by  the  unstable  eigen¬ 
functions  associated  with  the  eigenvalues 


A,  =  3  A2  =  0 


so  that 


dq  =  \/2smTz  <t>  2  =  \Z2sin2z: 


This  will  give  the  following  approximations  for  the  operators  I\c  and  I\  j 


(237) 


Ac  =  £T„(*,d>,T 


(238) 


•  V  V  O  *  *  ■.*  V  /  «' 


The  resulting  regulator  poles  will  coincide  with  a(A  —  BJ\C),  which  are 

fii  =  Ai  —  =  3  —  6.16  =  —3.16 

f-l  2  —  A  2  —  Q22  =  0  —  1  —  — 1 

P,  =  A,  i  =  3,4,... 

Since  for  this  problem  pn  =  qu,  the  filter  will  have  the  same  poles. 

This  approximation  will  provide  a  second  order  controller  that  stabilizes  the 
system  with  an  exponential  growth  constant  of  -1.  Therefore,  this  controller  will 
retain  stability  for  bounded  perturbations  whose  norm  is  less  than  1.  If  one  were  to 
solve  for  the  semigroup  generated  by  (A  —  BKC)  and  (A  —  A/C)  and  find  a  constant 
M  such  that 

II  T(t)  ||  <  Me-' 

then  one  could  use  Lemma  3.4.2  and  determine  that  the  system  would  remain  stable 
in  the  presence  of  relatively  bounded  perturbations  that  satisfy 

II  A  II  <  «  II  A  || 

where  a  <  {M  +  l)-1.  Other  than  these  two  types  of  perturbations,  it  is  not  readily 
apparent  as  to  how  robust  the  resulting  closed-loop  system  will  be.  Also,  for  more 
complicated  problems,  it  may  not  be  so  easy  to  calculate  resulting  closed-loop  poles 
to  determine  the  growth  constant  of  the  closed-loop  system  [17]. 

7-4  Banks  Approximation 

Another  approach  one  can  take  is  that  of  Banks  [7]  as  discussed  in  Sec¬ 
tion  4  of  Chapter  4.  With  this  approach,  one  selects  an  approximation  scheme  and 
uses  it  to  approximate  the  state  space  operators.  Then,  using  these  approximations, 
one  can  approximate  the  solution  of  the  A.R.E.  and  base  the  finite-dimensional 
controller  on  that  solution.  One  possible  approximation  scheme  is  to  use  modal 


approximation  as  was  mentioned  in  Section  4.4.  Using  this  technique,  one  can  write 
Ak  as 

Ak  =  PkA  =  £  A,<*,  4>,)d>,  (239) 

i=i 

and  the  semigroup  generated  by  Ak  can  be  written  as  [51  ]: 

Tk(t)  =  £>*•'(*,&)*.  (240) 

«=i 

Also,  the  operators  B,C,  and  Qc  can  be  approximated  as 

Bk  =  Pkl  =  Pk 

PkC  =  Pkl  =  Pk 
PkQc  =  Pkl  =  Pk 

Using  these  modal  approximations  results  in  the  Riccati  equation 

(A,  +  A>„  +  (Pk4>i.<f>j)  =  EEP.*Pr(^1^Vt,Bl^r)  ( 24  i ) 

*=  1  r=l 

which  yields  the  following  equation  for  p„: 

( — 2»2  +  8)p„  -f  1  =  pf,  (242) 

This  will  result  in  the  same  controller  that  was  obtained  using  Schumacher's 
approach.  A  different  approximation  scheme  would  likely  result  in  a  different  con¬ 
troller  form,  just  as  a  different  choice  of  the  isomorphism  R  would  likely  produce 
a  different  result  using  Schumacher's  approach.  The  robustness  is  analyzed  in  the 
manner  demonstrated  the  previous  section. 

7.5  Optimal  Projection  Equations 

Because  of  the  limited  robustness  analysis  of  the  two  methods  used  so 
far,  a  different  approach  would  be  useful  if  it  gave  more  insight  into  the  robustness 
of  the  resulting  controller.  Ideally  it  would  be  desirable  to  place  the  robustness 
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constraint  into  the  design  equations.  One  such  technique  is  the  LQG/LTR  technique 
[51].  However,  that  technique  has  not  been  extended  to  the  class  of  problems  where 
Am  is  unbounded  and  R{B)  U  R{Qj)  is  not  contained  in  a  finite-dimensional  space. 


One  could  approximate  the  LQG/LTR  technique  as  was  discussed  in  Section 
4.4,  or  one  could  use  the  O.P.E.  approach  [10]  discussed  in  Chapter  5.  The  opti¬ 
mum  projection  equations  (O.P.E.)  have  been  extended  to  the  entire  class  of  prob¬ 
lems  considered  in  this  research.  Using  this  approach,  one  must  select  operators  A 
and  T  which  define  the  projection  of  the  compensator.  The  resulting  compensator 
operators  (see  Equations  (141)  -  (143))  are  defined  by: 


Ac  =  T{A  -  QC‘R~j'C  -  BR~c'BmP) A* 


(243) 


Bc  =  TQC'R-j 1  =  TKj 


(244) 


Cc  =  -R-'B'PA'  =  —  KCA‘ 


where  Q  and  P  satisfies  the  four  coupled  equations  (see  Equations  (134)  -  (137)): 


AQ  +  QAm  +  Qj  -  QC-R-/CQ  +  rxQCm  R]' CQt‘x  =  0 


(246) 


a-p  +  pa  +  qc  -  pbr;xB‘P  +  tIPBR;' B'Ptx  =  o 


(247) 


(A-BR;'B-P)Q  +  Q(A-BR;'B-Py  +  QC’R]'CQ  +  T1QC-R]'CQT1  =  0  (248) 
(A-QC' Rj'cy P+  P(A-QC- R]'C)+  PBR;1  Bm P+t'xPBR;x B' Pt±  =  0  (249) 


These  four  equations  are  coupled  through  the  projection  operator  r  =  AT, 
and  the  solution  involves  the  simultaneous  solution  of  all  four  equations.  This  will  in 

I 

general  produce  a  different  solution  than  that  obtained  by  projecting  the  standard 
uncoupled  A.R.E.  solutions. 


One  possible  choice  of  T  is  the  projection  operator  Pk,  and  then  A"  will  be 
the  inverse  of  Pk.  At  first  it  would  appear  that  this  would  give  the  same  result 
that  was  obtained  using  Schumacher’s  approach.  However,  the  answers  will  differ 


/.  /_  /.  ■*, 


in  that,  the  approximation  of  A'/,  A'/,  appears  in  the  defining  equation  for  Ac  when 
using  Schumacher's  approach,  but  the  O.P.E.  approach  has  the  operator  Kj  in  the 
defining  equation  for  Ac  (and  likewise  for  Kc).  This  is  due  to  the  coupling  that  is 
present  in  the  A.R.E.  when  using  the  O.P.E. ’s.  One  thing  to  note  is  that  the  O.P.E. 
approach  will  include  the  Schumacher  approach  solutions  by  setting  the  noise  term 
Q j  used  in  Schumacher’s  approach  equal  to  the  term  Qj  +  t±QC‘  Rj*  CQt±  used  in 
the  O.P.E.  approach  (and  similarly  for  Qc). 

The  O.P.E.  approach  will  allow  one  to  select  an  operator  ft  (which  bounds 
the  system  uncertainty)  that  satisfies  Theorem  5.3.3,  and  thus  achieve  robustness 
to  perturbations  by  including  ft  in  the  A.R.E. 's,  as  was  discussed  in  Chapter  5.  The 
drawback  to  this  approach  is  the  difficulty  in  solving  the  coupled  equations  and  the 
lack  of  an  available  algorithm.  Algorithm  development  is  being  persued  by  Hyland 
[46]  who  has  presented  limited  results  for  finite-dimensional  systems.  The  algorithm 
used  by  Hyland  has  not  been  published,  and  is  not  readily  available. 

7.6  II  ^  Approach 

The  fourth  approach  to  robustness  that  was  discussed  in  this  research 
was  the  use  of  H ^  techniques  of  Section  4  of  Chapter  6.  When  using  this  approach, 
one  needs  to  solve  for  the  plant  transfer  function  and  the  compensator  transfer 
function.  For  the  problem  at  hand,  the  plant  transfer  function  is  given  by 

G(s)  =  C(sl  -  A)~'B  =  (si  -  A)~l  (250) 

Matson  [51]  shows  that  one  can  write  (si  —  A)-1  as: 

(si -a)-'  =  ^  *25,> 

Using  this  fact,  and  recalling  the  definitions  of  B  and  C  for  this  problem,  the 
operator  G(s)  can  be  written  as 


K- 


> 


£ 


*  -  V  ’ 
Ln'aV 


From  Equation  (197)  of  Chapter  6,  the  compensator  has  the  transfer  function 


A  ( «s )  —  K  c(  si  —  A  +  B  A  c  +  A  /  C1 )  Ay 


(253) 


which,  for  a  second  order  approximation  (which  is  chosen  since  only  two  unstable 
eigenvalues  exist),  can  be  written  as 

2  2 


!<{*)  =  {'52Pu{+,<}>)0>){sl  -  A  +  J\c  +  I\})  ’(£  q„(*  <£,)$>,) 

*=1  1=1 

Note  that  the  operator  (.4  —  Ac  —  K j)  can  be  expressed  as 

°c  2  2 

(.4  -  l\c  -  A*/)  =  Y1  K(**<t>,)<i>,  -  ^2p»(*,<t>,)4>,  -  Y2  Qn (*,&>) 6 1 

i=i  i=i  i=i 

which  for  this  problem  is  equivalent  to 

(.4  -  Ac  -  Kj)  =  ^(A,  -  2pt, ){*,<?,) 6, 


(255) 


(256) 


«=i 


Using  this  equation,  one  can  write  the  operator  (si  —  A  +  I\c  +  Kf)  1  as 


(si  ~  a  +  hc  +  h j)  1  —  y>.o,) 


1=1 


5-/2, 


(257) 


where  //,  =  (A,  -  2p„). 

Substituting  this  into  Equation  (254)  gives 


A(s)  = 


-  Pn 


+ 


P22 


5  -  /i!  S  -  // 2 

which,  upon  substituting  for  pu,p22,pi,  and  /i2,  gives 

-  38.95(s  +  2.19) 

(5  +  9.32)(5  +  2) 

Using  this  expression  for  A(s)  then  yields  that  G(s)A'(s)  is  equal  to 

G(a)K(,s)  =  ( jjA—  +  j)(A’(»)) 

n.9(s-1.5)(s  +  2.19)(s-1.5) 
G(S,A(')  -  »(*-3)(s  +  9.32)(,  +  2) 


128 


(258) 


(259) 


(260) 

(261) 


i 
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G($)K{s)  can  be  expressed  a 5  in  Equation  (260)  because  p,,  =  0  for  1  >  2.  G(s)  is 
really  an  infinite  sum  as  shown  in  Equation  (252). 


At  this  point  one  can  use  the  H0 0  sufficient  conditions  to  evaluate  the  robust¬ 
ness  of  this  approximation  with  respect  to  some  sensitivity  function  as  in  Section 
4  of  Chapter  6.  The  system  will  be  robustly  stable  with  respect  to  \VX  if 

||  GK(1-GK)-XVL’{'  ||oo<  1  (262) 


or.  using  the  sufficient  condition  of  Lemma  6.4.5,  the  system  will  be  robustly  stable 
using  this  compensator  if 


II  H’f 1  |U  < 


1 

||  {/  — (/  +  CA-)-1}  II 


(263) 


At  this  point  one  could  substitute  for  G(s)I\(s)  and  plot  the  right  hand  side  of 
Equation  (263)  to  get  a  bound  on  the  norm  of  the  sensitivity  function  as  a  function 
of  frequency.  If  the  norm  bound  is  too  small  in  a  frequency  range  of  concern,  then 
one  would  have  to  iterate  the  design  of  the  compensator.  However,  as  pointed  out 
by  others  [30],  increased  robustness  at  one  frequency  range  will  mean  giving  up 
performance  somewhere.  This  tradeoff  has  to  be  made  based  on  the  goals  to  be 
achieved. 


The  advantage  of  the  approach  is  that  it  allows  one  to  model  uncertainty 
as  either  a  multiplicative  or  additive  perturbation,  and  the  perturbations  occur  in 
the  transfer  function  instead  of  the  state  space  operators.  The  other  approaches  do 
not  allow  for  this  since  they  are  based  on  perturbations  to  the  state  space  operators. 
Since  a  transfer  function  description  of  a  system  and  its  perturbations  is  often  easier 
to  obtain  than  a  state  space  model,  in  many  cases,  the  H approach  may  be  more 
advantageous.  However,  the  disadvantage  of  the  H approach  is  that  it  is  very 
difficult  to  solve  the  problem  for  MIMO  distributed  parameter  systems.  Even  for 
finite-dimensional  problems,  MIMO  systems  are  quite  often  difficult  to  solve  using 
this  approach,  although  techniques  to  do  so  exist  [33]. 


VIII.  Conclusions  and  Recommendations 

8.1  Conclusions 

This  research  has  considered  finite-dimensional  LQG-based  control  of 
infinite-dimensional  systems  with  robustness  as  a  prime  issue.  In  Chapter  3,  Schu¬ 
macher's  direct  approach  [59]  to  finite-dimensional  compensator  design  was  used 
to  prove  the  existence  of  LQG-based  finite-dimensional  controllers  for  the  class  of 
systems  considered  in  this  research.  Schumacher  had  proven  the  existence  of  finite¬ 
dimensional  controller,  but  he  did  not  try  to  force  them  to  be  of  any  particular  type; 
this  research  did.  Also,  Schumacher  never  gave  a  proof  that  the  finite-dimensional 
controller  that  results  from  his  approach  converges,  as  the  controller  dimension  is 
increased  toward  oc,  to  the  infinite-dimensional  controller  upon  which  the  approx¬ 
imation  is  based.  This  research  provides  that  proof.  Finally,  the  limited  ability  to 
analyze  robustness  of  the  finite-dimensional  controller  obtained  via  Schumacher’s 
approach  was  pointed  out.  It  was  shown  how  one  can  evaluate  robustness  for  the 
case  of  bounded  and  relatively  bounded  perturbations. 

Chapter  4  reviewed  the  LQG/LTR  technique  that  Matson  [51]  extended  in  his 
work.  A  sufficient  condition  was  developed  that,  if  satisfied,  allows  the  technique 
to  be  applied  to  a  specific  class  of  systems.  First,  it  was  shown  that  if  the  operator 
h3  =  {BY B’  +  0~2Qj  —  0~2Y3C’ Rjx CYo)  is  uniformly  bounded  independent  of 
0 ,  and  if  I\3  is  positive  semi-definite,  then  the  LQG/LTR  technique  is  valid  for 
the  class  of  systems  described  in  Section  3  of  Chapter  1.  Second,  it  was  shown 
that  the  LQG/LTR  technique  is  valid  for  the  class  of  problems  for  which  the  inputs 
are  uniformly  bounded  (using  the  L 2  norm),  the  states  are  bounded  awray  from 
zero,  the  operator  C  is  unitary,  the  adjoint  of  the  B  operator  is  bounded  below, 
and  Qj  is  a  bounded  linear  operator  (see  Lemma  4.3.3).  The  class  of  systems 
is  not  physically  meaningful,  but  both  approaches  taken  to  extend  the  LQG/LTR 
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technique  are  different  from  that  taken  by  Matson.  It  is  hoped  that  these  new 
approaches  wil  shed  new  light  as  to  how  to  extend  the  LQG/LTR  technique  to  the 
entire  class  of  systems  considered  in  this  research.  As  an  alternative,  it  was  shown 
how  to  use  the  results  of  Banks  [7]  to  approximate  the  LQG/LTR  technique.  In  the 
same  way  that  he  approximates  the  solution  of  the  infinite-dimensional  algebraic 
Riccati  equation,  one  can  approximate  the  LQG/LTR  procedure. 

Chapter  5  considered  the  approach  being  taken  by  Bernstein  and  others  [10, 
11.  46,  9.  45,  39,  40]  to  achieve  finite-dimensional  control,  robustness,  and  optimum 
performance  at  perturbed  conditions,  all  in  one  design  procedure.  Using  the  optimal 
projection  equation  approach,  the  recent  results  of  Bernstein  [40]  were  extended  to 
the  infinite-dimensional  systems  considered  in  this  research.  The  extension  is  a  result 
of  the  theory  developed  by  Bernstein  in  [10],  but  the  important  result  obtained  was 
a  new  interpretation  of  the  LQG/LTR  technique  when  the  compensator  order  is 
fixed  to  be  less  than  the  model  order  describing  the  system  to  be  controlled.  It 
was  shown  that,  even  though  one  cannot  recover  a  desired  loop  transfer  function 
when  the  compensator  order  is  less  than  the  “truth'1  model  order,  one  can  achieve 
robustness  to  a  class  of  perturbations  that  are  a  function  of  the  modifying  noise 
term  32B\'B'.  As  shown  in  Theorem  5.3.3.  and  discussed  in  Section  4  of  Chapter 
5.  the  class  of  perturbations  are  those  for  which  A.4Q  +  QA.4"  <  ft  Vx  G  W,  where 
one  can  choose  ft  =  (32B\'Bm  when  the  uncertainty  is  restricted  to  the  A  operator, 
and  A.4  is  a  bounded  linear  operator.  This  is  an  insight  not  before  demonstrated 
in  the  literature. 

Chapter  6  considered  perturbations  that  occur  in  the  transfer  function.  By 
using  the  algebraic  theory  developed  by  Callier  and  Desoer  [12,  13],  coupled  with 
the  work  of  Curtain  [22]  and  Chen  and  Desoer  [16],  an  sufficient  condition  was 
established  that  can  be  used  as  a  design  tool  to  evalute  the  robustness  of  a  controller 
to  multiplicative  perturbations.  This  is  different  from  the  results  of  Curtain  [22] 
which  are  for  the  case  of  additive  perturbations.  In  this  way  her  results  have  been 


extended. 


Finally,  Chapter  7  gives  an  example  problem.  The  approach  of  Schumacher 
[59]  was  used  to  obtain  a  finite-dimensional  LQG-based  controller,  and  its  robust¬ 
ness  was  analyzed  using  the  techniques  of  Chapter  3.  Next,  Banks’  approximation 
approach  was  used,  and  it  was  shown  that,  for  the  problem  considered,  it  resulted 
in  the  same  controller  that  was  obtained  using  Schumacher’s  approach.  The  ad¬ 
vantage  of  using  Banks’s  approach  is  that  it  involves  approximating  the  algebraic 
Riccati  equations  (resulting  in  a  finite-dimensional  algebraic  Riccati  equation),  and 
so  can  be  used  as  an  approximation  to  the  LQG/LTR  technique.  Schumacher’s 
technique  involves  approximating  the  solution  of  the  infinite-dimensional  A.R.E.  for 
which  LQG/LTR  tun.ng  has  not  been  extended. 

The  optimal  projection  equation  approach  is  applied  to  the  problem,  but  it  is 
not  solved  since  an  algorithm  for  solving  the  four  coupled  equations  is  not  currently 
available.  However,  by  looking  at  the  structure  of  the  defining  equations,  one  can 
see  that  the  result  will  not  be  the  same  as  was  obtained  using  Schumacher’s  or 
Banks’  approaches.  Finally,  the  transfer  function  of  the  the  system  is  established, 
and  it  is  shown  how  to  use  the  H sufficient  condition  for  robustness  to  evalute  the 
controller  design.  In  the  example,  a  sensitivity  function  U'j  (which  is  inherent  to 
the  methodology)  was  not  assumed.  Rather,  the  problem  was  set  up  so  one  could 
solve  for  the  H’j  that  satisfies  the  robustness  sufficient  condition.  In  this  way  one 
can  establish  a  sufficient  condition  that,  if  satisfied,  will  guarantee  robustness  of  a 
stabilizing  controller. 

8.2  Proposed  Design  Procedure 

Based  on  the  developments  in  this  dissertation,  a  proposed  design  pro¬ 
cedure  is  presented.  This  procedure  is  just  one  possible  approach  to  the  problem. 
A  better  procedure  may  be  possible  by  changing  the  order  of  the  steps,  or  by  per¬ 
forming  any  of  the  steps  in  a  different  fashion. 


1 .  Determine  the  operators  Kj  and  Kc,  using  the  optimal  control  theory  of  Chap¬ 
ter  2,  that  provide  an  acceptable  degree  of  exponential  stability  of  the  closed- 
loop  sytem. 

2.  Adjust  the  operator  Kc  if  necessary  to  ensure  that  the  eigenfunctions  of  (A  — 
BI\C)  are  complete. 

3.  Determine  the  exponential  growth  constant  associated  with  the  operator  ( A  — 
KjC).  Adjust  K j  if  necessary  so  that  the  growth  constant  of  (A  —  KjC)  is 
sufficiently  less  than  zero.  Increasing  this  growth  constant  will  likely  lower  the 
order  of  the  finite-dimensional  controller  since  the  magnitude  of  the  growth 
constant  determines  how  closely  Kj  has  to  be  approximated  (see  Theorem 
3.2.2). 

4.  Use  Shumacher’s  approach  to  design  a  finite-dimensional  approximation  of  the 
infinite-dimensional  LQG  controller. 

5.  Use  a  robustness  enhancement  technique,  and  determine  the  robustness  of  the 
system  with  respect  to  the  type  of  perturbations  one  wishes  to  consider. 

6.  Determine  the  closed-loop  pole  locations  and  analyze  the  system's  robustness 
and  performance. 

Clearly,  there  are  alternatives  for  some  of  the  steps.  For  example,  if  the 
LQG/LTR  technique  is  valid,  then  one  could  include  robustness  recovery  as  part  of 
the  design  in  step  1.  However,  if  one  is  approximating  the  LQG/LTR  technique, 
then  the  robustness  recovery  will  take  place  when  the  finite-dimensional  controller  is 
designed.  Also,  since  none  of  the  approaches  can  consider  every  type  of  perturbation, 
the  type  of  perturbation  will  influence  the  steps  in  the  design.  Finally,  iterations  at 
one  step  may  impact  the  ability  to  perform  a  later  step.  Therefore,  the  procedure 
may  not  be  as  sequencial  as  indicated.  It  may  be  better  to  do  some  steps  at  the  same 
time.  Development  of  a  good  design  procedure  using  the  results  of  this  dissertation 
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is  a  good  topic  for  future  research.  The  procedure  given  here  is  simply  a  starting 
point. 

8.3  Recommendations 

There  are  several  recommendations  for  future  research.  It  would  be 
very  helpful  to  develop  an  algorithm  for  solving  the  optimal  projection  equations. 
It  may  be  possible  to  use  an  approach  similar  to  that  of  Banks  and  approximate  the 
solution.  However,  this  would  mean  solving  the  optimal  projection  equations  in  a 
finite-dimensional  form,  and  the  algorithm  for  that  is  just  now  being  developed  [44], 

Obviously,  it  would  be  worthwhile  if  one  could  extend  the  LQG/LTR  technique 
to  a  larger  class  of  systems  than  that  for  which  it  is  currently  valid.  It  is  hoped  that 
the  work  found  in  Chapter  4  will  give  some  insight  as  to  how  to  do  that. 

Also,  it  would  be  interesting  to  see  if  Schumacher's  approach  could  be  extended 
to  incorporate  robustness.  If  the  LQG/LTR  technique  is  ever  extended  to  the  entire 
class  of  problems,  this  could  be  used  as  the  basis  of  the  approximation.  Also, 
by  making  a  connection  between  the  optimal  projection  equation  approach  and 
Schumacher’s,  it  may  be  possible  to  gain  insight  into  this. 

Another  area  for  research  is  considering  other  types  of  controllers.  This  re¬ 
search  considered  regulators.  It  may  be  useful  to  consider  proportional  plus  integral 
controllers  as  was  done  by  Pohjolainen  [55].  Trackers,  disturbance  rejection  con¬ 
trollers,  and  other  forms  of  controllers  also  warrant  attention.  One  also  needs  to 
consider  the  issue  of  performance  which  was  ignored  in  this  research.  Increasing 
robustness  is  normally  accomplished  at  the  expense  of  performance  at  design  con¬ 
ditions.  A  tradeoff  occurs  in  practice,  and  it  would  be  worthwhile  to  express  this 
trade-off  in  mathematical  terms  for  infinite-dimensional  systems. 

As  was  mentioned  earlier,  it  would  be  very  useful  to  refine  the  design  proce¬ 
dure  of  the  previous  section.  It  is  unknown  exactly  how  the  design  steps  interact. 
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However,  it  is  believed  that  the  LQG/LTR  is  valid  for  the  entire  class  of  systems 
considered  in  Chapter  1.  This  is  expressed  in  the  following  conjecture. 


Conjecture:  For  the  class  of  systems  described  in  Section  3  of  Chapter  1,  the 
operator  Kp  of  Theorem  4.2.1  is  uniformly  bounded  independent  of  /?,  and  is  either 
positive  semi-definite,  or  negative  semi-definite. 

The  conjecture  allows  Kp  to  be  either  positive  or  negative  semi-definite  since 
Theorem  4.2.1  can  be  proven  for  either  case  (just  reverse  the  signs  in  the  proof). 
Though  neither  condition  has  been  proven,  it  is  believed  that  one  or  the  other  will 


Finally,  it  would  be  worthwhile  to  extend  any  of  the  results  in  this  research  to 
the  case  of  unbounded  B  and  C  operators.  This  would  make  the  results  applicable 
to  a  larger  class  of  problems. 


Bibliography 

1.  A.  V.  Balakrishnan.  Applied  Functional  Analysis.  Springer- Verlag,  New  York, 

1981. 

2.  M.  J.  Balas.  Adaptive  Parameter  Estimation  of  Large-Scale  Systems  by 
Reduced-Order  Modeling.  In  Proceedings  of  the  Automatic  Controls  Confer¬ 
ence ,  pages  575-579,  San  Francisco,  Ca.,  1983. 

3.  M.  J.  Balas.  Feedback  Control  of  Flexible  Structures.  IEEE  Transactions  on 
Automatic  Control ,  23(4):673-679,  1978. 

4.  M.  J.  Balas.  Linear  Distributed  Parameter  Systems:  Closed-loop  Exponential 
Stability  with  a  Finite-Dimensional  Controller.  Automatica,  20(3):37 1—377, 
1984. 

5.  M.  J.  Balas.  Modal  Control  of  Certain  Flexible  Dynamic  Systems.  SIAM 
Journal  of  Control  and  Optimization,  16(3):450-462,  1978. 

6.  M.  J.  Balas.  Trends  in  Large  Space  Structure  Control  Theory:  Fondest  Hopes. 
Wildest  Dreams.  IEEE  Transactions  on  Automatic  Control,  AC-27(3):522-535. 

1982. 

7.  H.  T.  Banks  and  K.  Kunisch.  The  Linear  Regulator  Problem  for  Parabolic  Sys¬ 
tems.  SIAM  Journal  of  Control  and  Optimization ,  22(5):684-698,  September 
1984. 

8.  A.  Belleni-Morante.  Applied  Semigroups  and  Evolution  Equations.  Oxford 
University  Press,  Walton  St.,  Oxford,  1979. 

9.  D.  S.  Bernstein  and  W.  M.  Haddad.  The  Optimal  Projection  Equations  with 
Peterson-Hollot  Bounds:  Robust  Controller  Synthesis  with  Guaranteed  Struc¬ 
tured  Stability  Radius.  In  Proceedings  of  the  26th  Conference  on  Decision  and 
Control,  pages  1308-1318,  Los  Angeles,  Ca,  December  1987. 

10.  D.  S.  Bernstein  and  D.  C.  Hyland.  The  Optimal  Projection  Equa¬ 
tions  for  Finite-Dimensional  Fixed-Order  Dynamic  Compensation  of  Infinite- 
Dimensional  Systems.  SIAM  Journal  of  Control  and  Optimization,  24 ( 1 ):  122— 
151,  January  1986. 

11.  D.  S.  Bernstein  and  D.  C.  Hyland.  The  Optimal  Projection  Equations  for 
Fixed-Order  Dynamic  Compensation  of  Distributed-Parameter  Systems.  In 
Proceedings  of  AIAA  Dynamics  Specialists  Conference,  pages  396-400,  Palm 
Springs,  Ca,  May  1984. 

12.  F.  M.  Callier  and  C.  A.  Desoer.  An  Algebra  of  Transfer  Functions  for  Dis¬ 
tributed  Linear  Time-Invariant  Systems.  IEEE  Transactions  on  Circuits  and 
Systems,  CAS-25(9):651-662,  1978. 


13.  F.  M.  Callier  and  C.  A.  Desoer.  Simplifications  and  Clarifications  on  the  Pa¬ 
per  “An  Algebra  of  Transfer  Functions  for  Distributed  Linear  Time-Invariant 
Systems”.  IEEE  Transactions  on  Circuits  and  Systems ,  CAS-27(4 ) :320 - 323 , 
1980. 

14.  F.  M.  Callier  and  C.  A.  Desoer.  Stabilization,  Tracking,  and  Disturbance  Rejec¬ 
tion  in  Multivariable  Convolution  Systems.  Annalcs  de  la  Socicte  Scientifique 
dc  Bruxelles ,  T.  94(  1  ):7— 51 ,  1980. 

15.  F.  M.  Callier  and  J.  Winkin.  Distributed  System  Transfer  Functions  of  Expo¬ 
nential  Order.  International  Journal  of  Control ,  43(5):  1 353— 1373,  1986. 

16.  M.  J.  Chen  and  C.  A.  Desoer.  Necessary  and  Sufficient  Conditions  for  Robust 
Stability  of  Linear  Distributed  Feedback  Systems.  International  Journal  of 
Control  35(2):255-267,  1982. 

17.  R.  F.  Curtain.  Pole  Assignment  for  Distributed  Systems  by  Finite-Dimensional 
Control.  Automatica ,  57-67,  1985. 

18.  R.  F.  Curtain.  A  Semigroup  Approach  to  the  LQG  Problem  for  Infinite- 
Dimensional  Systems.  IEEE  Transactions  on  Circuits  and  Systems.  CAS- 
25(9):713-721 .  September  1978. 

19.  R.  F.  Curtain.  Equivalence  of  Input-Output  Stability  and  Exponential  Stability 
for  Infinite  Dimensional  Systems.  Technical  Report  TW-276,  Mathematics 
Institute  Rijksuniveriteit  Groningen,  P.O.  Box  800,  9700  AV  Gronigen.  The 
Netherlands,  August  1987. 

20.  R.  F.  Curtain.  Finite-Dimensional  Compensator  Design  for  Parabolic  Dis¬ 
tributed  Systems  with  Point  Sensors  and  Boundary  Input.  IEEE  Transactions 
on  Automatic  Control ,  AC-27(1):98-104,  1982. 

21.  R.  F.  Curtain.  Finite-Dimensional  Compensators  for  Parabolic  Distributed 
Systems  wuth  Unbounded  Control  and  Observation.  SIAM  Journal  of  Control 
and  Optimization ,  22(2):255-276,  1984. 

22.  R.  F.  Curtain  and  K  Glover.  Robust  Stabilization  of  Infinite  Dimensional 
Systems  by  Finite  Dimensional  Controllers.  Systems  and  Control  Letters ,  7:41- 
47,  February  1986. 

23.  R.  F.  Curtain  and  A.  J.  Pritchard.  Compensators  for  Infinite  Dimensional 
Linear  Systems.  Journal  of  the  Franklin  Institute,  3 1 5(5/6):33 1  —346,  1983. 

24.  R.  F.  Curtain  and  A.  J.  Pritchard.  Infinite  Dimensional  Linear  System  Theory. 
Springer- Verlag,  New  York,  1978. 

25.  J.  J.  D’Azzo  and  C.  Houpis.  Linear  Control  System  Analysis.  McGraw-Hill. 

New  York,  1981. 

26.  C.  A.  Desoer  et  al.  Feedback  System  Design:  The  Fractional  Representation 
Approach  to  Analysis  and  Synthesis.  IEEE  Transactions  on  Automatic  Control, 
AC-25(3):399-412,  1980. 


27.  C.  A.  Desoer  and  C.  L.  Gustafson.  Algebraic  Theory  of  Linear  Multivariable 
Feedback  Systems.  IEEE  Transactions  on  Automatic  Control,  AC-29(10):909- 
916,  1984. 

28.  C.  A.  Desoer  and  M.  Vidyasagar.  Feedback  Systems:  Input-Output  Properties. 
Academic  Press,  New  York,  1975. 

29.  J.  L.  Doob.  Stochastic  Processes.  John  Wiley  and  Sons,  Inc.,  New  York,  1953. 

30.  J.  C.  Doyle  and  G.  Stein.  Multivariable  Feedback  Design:  Concepts  for  a 
Classical/Modern  Synthesis.  IEEE  Transactions  on  Automatic  Control ,  AC- 
26(1  ):4-16,  1981. 

31.  J.  C.  Doyle  and  M.  Vidyasagar.  Guaranteed  Margins  for  LQG  Regulators. 
IEEE  Transactions  on  Automatic  Control,  AC-23(4):756-757,  1978. 

32.  J.  C.  Doyle,  J.  E.  Wall,  and  G.  Stein.  Performance  and  Robustness  Analysis 
for  Structured  Uncertainty.  In  Proceedings  of  the  1982  IEEE  Conference  on 
Decision  and  Control,  pages  629-636,  Orlando.  Florida,  1982. 

33.  B.  A.  Francis.  A  Course  in  H-Infinity  Control  Theory.  Lecture  Notes  in  Control 
and  Information  Sciences,  Springer- Verlag,  New  York,  1987. 

34.  B.  A.  Francis  and  J.  C.  Doyle.  Linear  Control  Theory  with  an  H-infinity  Op¬ 
timality  Criterion.  SIAM  Journal  of  Control  and  Optimization,  25(4  ):8 1 5—844 , 
July  1987. 

35.  J.  S.  Fruedenberg,  D.  P.  Looze,  and  J.  B.  Cruz.  Robustness  Analysis  Using 
Singular  Value  Sensitivities.  International  Journal  of  Control,  35(  1  ):95-l  16. 
1982. 

36.  I.  M.  Gelfand  and  S.  V.  Fomin.  Calculus  of  Variations.  Prentice-Hall,  Inc., 
Englewood  Cliffs.  New  Jersey,  1963. 

37.  I.  M.  Gelfand  and  G.  E.  Shilov.  Generalized  Functions  Vol  1.  Academic  Press, 
New  York,  1964. 

38.  J.  S.  Gibson.  The  Riccati  Integral  Equations  for  Optimal  Control  Problems 
on  Hilbert  Space.  SIAM  Journal  of  Control  and  Optimization,  17(4 ):537— 565, 
January  1979. 

39.  S.  W.  Greeley,  D.  C.  Hyland,  and  S.  Richter.  Reduced-Order  Compensa¬ 
tion:  LQG  Reduction  Versus  Optimal  Projection  Using  a  Homotopic  Continu¬ 
ation  Method.  In  Proceedings  of  the  26th  Conference  on  Decision  and  Control, 
pages  742-747,  Los  Angeles,  Ca,  December  1987. 

40.  W.  M.  Haddad  and  D.  S.  Bernstein.  The  Unified  Optimal  Projection  Equations 
for  Simultaneous  Reduced-Order,  Robust  Modeling,  Estimation  and  Control. 
In  Proceedings  of  the  26th  Conference  on  Decision  and  Control,  pages  449-454, 
Los  Angeles,  Ca,  December  1987. 


41.  P.  R.  Halmos.  A  Hilbert  Space  Problem  Book.  Princeton:  D.  Van  Nostrand 
Co.,  Inc.,  1967. 

42.  E.  Hille  and  R.  S.  Phillips.  Functional  Analysis  and  Semigroups.  Volume  31, 
American  Mathematical  Society  Colloquium  Publications,  1957. 

43.  I.  Horowitz.  Synthesis  of  Feedback  Systems.  Academic  Press,  New  York,  1963. 

44.  D.  C.  Hyland.  The  Optimal  Projection  Approach  to  Fixed-Order  Compensa¬ 
tion:  Numerical  Methods  and  Illustrative  Results.  In  AIAA  21st  Aerospace 
Sciences  Mtg.  pages  83-0303,  Reno,  Nv.,  1983. 

45.  D.  C.  Hyland  and  D.  S.  Bernstein.  Explicit  Optimality  Conditions  for  Fixed- 
Order  Dynamic  Compensation.  In  Proceeding  of  Conference  on  Decision  and 
Control ,  pages  161-165,  San  Antonio,  Tx,  December  1983. 

46.  D.  C.  Hyland  and  D.  S.  Bernstein.  The  Optimal  Projection  Equations  for  Fixed- 
Order  Dynamic  Compensation.  IEEE  Transactions  on  Automatic  Control ,  AC- 
29(  1 1 ) :  1 03-4  —  1037,  November  1984. 

47.  C.  A.  Jacobson.  Some  Aspects  of  the  Structure  and  Stability  of  a  Class  of 
Linear  Distributed  Systems.  Master’s  thesis,  Rensselaer  Polytechnic  Institute. 
Troy,  New  York,  May  1984. 

48.  T.  Kato.  Perturbation  Theory  for  Linear  Operators.  Springer- Verlag.  New 
York,  1966. 

49.  H.  Kwakernaak  and  R.  Sivan.  Linear  Optimal  Control  Systems.  Wiley - 

Interscience,  New  York  ,  1972. 

50.  D.  L.  Lukes  and  D.  L.  Russell.  The  Quadratic  Criterion  for  Distributed  Sys¬ 
tems.  SIAM  Journal  of  Control  and  Optimization ,  7:101-121,  1969. 

51.  C.  L.  Matson.  The  Linear  Quadratic  Gaussian  /  Loop  Transfer  Recovery  Tech¬ 
nique  for  a  Class  of  Distributed  Parameter  Systems.  PhD  thesis,  Air  Force 
Institute  of  Technology,  Wright- Patterson  AFB,  Ohio,  December  1986. 

52.  A.  W.  Naylor  and  G.  R.  Sell.  Linear  Operator  Theory  in  Engineering  and 
Science.  Springer- Verlag,  New  York,  1982. 

53.  C.  N.  Nett.  The  Fractional  Representation  Approach  to  Robust  Linear  Feedback 
Design:  A  Self-Contained  Exposition.  Master’s  thesis,  Rensselaer  Polytechnic 
Institute,  Troy,  New  York,  1984. 

54.  A.  Pazy.  Semigroups  of  Linear  Operators  and  Applications  to  Partial  Differen¬ 
tial  Equations.  Springer- Verlag,  New  York,  1983. 

55.  S.  A.  Pohjolainen.  Robust  Multivariable  Pi-Controller  for  Infinite-Dimensional 
Systems.  IEEE  Transactions  on  Automatic  Control ,  AC-27(l):17-30,  1982. 

56.  M.  Sakawa.  Feedback  Stabilization  of  a  Class  of  DPS  and  Construction  of 
a  State  Estimator.  IEEE  Transactions  on  Automatic  Control  AC-6:748-753, 
1975. 


57.  N.  R.  Sandell.  Robust  Stability  of  Linear  Dynamic  Systems  unth  Application  to 
Singular  Perturbation  Theory,  Recent  Developments  in  the  Robustness  Theory 
of  Multivariable  Systems  .  Technical  Report  LIDS-R-954,  MIT  Laboratory  for 
Information  Decision  Systems,  August  1979. 

58.  J.  M.  Schumacher.  A  Direct  Approach  to  Compensator  Design  for  Distributed 
Systems.  SIAM  Journal  of  Control  and  Optimization ,  21:823-836,  1983. 

59.  J.  M.  Schumacher.  Dynamic  Feedback  in  Finite-  and  Infinite-Dimensional  Lin¬ 
ear  Systems.  PhD  thesis,  Mathematisch  Centrum,  M.  C.  Tracts  No.  143,  Am¬ 
sterdam,  1982. 

60.  J.  M.  Schumacher.  Finite-Dimensional  Regulators  for  a  Class  of  Infinite- 
Dimensional  Systems.  Systems  and  Control  Letters,  3:7-12,  1983. 

61.  L.  Schwartz.  Theorie  des  Distributions  .  Hermann,  Paris,  1966. 

62.  G.  Stein  and  J.  C.  Doyle.  Robustness  with  Observers.  IEEE  Transactions  on 
Automatic  Control ,  AC-24(4):607-611,  August  1979. 

63.  G.  \V.  Stewart.  Introduction  to  Matrix  Computations.  Academic  Press.  New 
York.  1973. 

64.  A.  E.  Taylor  and  D.  C.  Lay.  Introduction  to  Functional  Analysis.  Wiley  and 
Sons,  second  edition,  1980. 

65.  R.  Triggiani.  On  the  Stabilizability  Problem  in  Banach  Space.  Journal  of 
Mathematical  Analysis  and  Applications,  52:383-403,  1975. 

66.  M.  Yidyasagar.  Control  System  Synthesis:  A  Factorization  Approach.  MIT 
Press,  Cambridge,  Mass,  1985. 

67.  M.  Yidyasagar,  H.  Schneider,  and  B.  A.  Francis.  Algebraic  and  Topological 
Aspects  of  Feedback  Stabilization.  IEEE  Transactions  on  Automatic  Control. 
AC-27(4  ):880-894,  1982. 

68.  W.  M.  Wonham.  Linear  Multivariable  Control:  A  Geometric  Approach. 
Springer- Verlag,  New  York,  1979. 

69.  R.  K.  Yedavalli  and  Z.  Liang.  Reduced  Conservatism  in  Stability  Robustness 
Bounds  by  State  Transformation.  IEEE  Transactions  on  Automatic  Control. 
AC-31  (9):863-866,  1986. 

70.  K.  Yosida.  Functional  Analysis.  Springer- Verlag,  Berlin,  sixth  edition,  1980. 

71 .  G.  Zames.  On  The  Input-Output  Stability  of  Nonlinear  Time- Varying  Feedback 
Systems,  Part  I  .  IEEE  Transactions  on  Automatic  Control,  AC-1 1 :228-238, 
1966. 


^  >  .>  _* 


Vita 

Randall  Norris  Paschal!  was  born  on  23  June  1958  in  Memphis,  Tennessee. 
He  graduated  from  Raleigh-Egypt  High  School  in  1976,  and  attended  Oklahoma 
University  on  a  Navy  ROTC  scholarship  during  his  freshman  year  of  college.  He 
left  Oklahoma  and  returned  home  where  he  attended  Christian  Brothers  College  in 
Memphis.  He  graduated  in  May  1980  a s  a  distinquished  graduate  of  the  Air  Force 
ROTC  program  at  Memphis  State  University  with  a  Bachelor  of  Science  in  Electri¬ 
cal  Engineering  from  Christian  Brothers  College.  Upon  graduation,  he  recieved  a 
commission  as  a  Second  Lieutenant,  and  entered  the  School  of  Engineering  at  the 
Air  Force  Institute  of  Technology  in  June  1980.  He  entered  the  graduate  program 
in  guidance  and  control,  and  graduated  in  December  1981  with  a  Master  of  Science 
in  Electrical  Engineering.  Upon  graduation  he  went  to  Eglin  AFB,  Florida  where 
he  was  an  engineer  for  the  range  instrumentation  program  office  and  a  controls  en¬ 
gineer  for  the  low  level  laser  guided  bomb  program  office.  In  June  1985  he  entered 
the  Ph.D.  program  at  the  Air  Force  Institute  of  Technology. 


Permanent  address:  6930  Hubbard  Drive 

Huber  Heights,  Ohio  45424 


y 

y 


BaBamB^BHiBiBiaEanaafflai 


la  REPORT  SECURITY  CLASSIFICATION 

UNCLASSIFIED 


2a  SECURITY  CLASSIFICATION  AUTHORITY 


2b  DECLASSIFICATION /DOWNGRADING  SCHEDULE 


4.  PERFORMING  ORGANIZATION  REPORT  NUMBER(S) 

AFIT/DS/ENG/88J-I 


REPORT  DOCUMENTATION  PAGE 


lb.  RESTRICTIVE  MARKINGS 


Form  Approved 
OMB  No.  0704  0188 


3.  DISTRIBUTION/AVAILABILITY  OF  REPORT 
Approved  for  public  release; 
distribution  unlimited. 


5.  MONITORING  ORGANIZATION  REPORT  NUMBER(S) 


6a.  NAME  OF  PERFORMING  ORGANIZATION  6b  OFFICE  SYMBOL  7a.  NAME  OF  MONITORING  ORGANIZATION 

School  of  Engineering  /fI?9eNG  ^ 


6c.  ADDRESS  (City.  State,  and  ZIP  Code) 

Air  Force  Institute  of  Technology 
Wrlght-Patterson  AFB,  Ohio  45433-6583 


7b.  ADDRESS  (City,  State,  and  ZIP  Code) 


8a.  NAME  OF  FUNDING /SPONSORING 
ORGANIZATION 


8b.  OFFICE  SYMBOL  I  9.  PROCUREMENT  INSTRUMENT  IDENTIFICATION  NUMBER 
(If  applicable)  I 


8c  ADDRESS  (City,  State,  and  ZIP  Code) 

10  SOURCE  OF  FUNDING  NUMBERS 

PROGRAM 

PROJECT 

TASK 

WORK  UNIT 

ELEMENT  NO 

NO 

NO 

ACCESSION  NO 

1 1  TITLE  (Include  Security  Classification) 

ROBUST  FINITE -DIMENSIONAL  LOG-BASED  CONTROLLERS  FOR  A  CLASS  OF  DISTRIBUTED 

PARAMETER  SYSTEMS  (UNCLASSIFIED) 

12  PERSONAL  AUTHOR(S) 

Randall  N.  Paschall, 

Capt,  USAF 

1 3a.  TYPE  OF  REPORT 

13b  TIME  COVERED 

14.  DATE  OF  REPORT  (Year,  Month,  Day) 

15.  PAGE  COUNT 

PhD  Dissertation 

FROM  TO 

1988  June 

162 

COSATI  CODES 


18  SUBJECT  TERMS  ( Continue  on  reverse  if  necessary  and  identify  by  block  number) 
Optimal  Control,  Distributed  Parameter  Systems,  Kalman 
filter,  Semigroup,  Perturbations 


19  ABSTRACT  (Continue  on  reverse  if  necessary  and  identify  by  block  number) 


FIELD 

GROUP 

09 

03 

Chairman  of  Advisory  Committee:  Peter  S.  Maybeck 

Professor  of  Electrical  Engineering 


yww4  loi  Bufcllc  r*!«<u»:  IAW  AFR  190-)/ 

ifL^xY 

Dean  itn  Scstatcb  and  Professiomll  Development 
Air  Force  lxuAilule  ol  technology  IAAG*" 

AFB  OH- 


20  DISTRIBUTION  /  AVAILA8ILITY  OF  ABSTRACT  21  ABSTRACT  SECURITY  CLASSIFICATION 

□  UNCLASSIFIED/UNLIMITED  Q0  SAME  AS  RPT.  □  DTIC  USERS  UNCLASSIFIED 


22b  TELEPHONE  (Include  Area  Code) 

513)  255-3576 


DO  Form  1473,  JUN  86  Previous  editions  are  obsolete.  SECURITY  CLASS 


I W  Till 


•SECURITY  CLASSIFICATION  OF  THIS  PAGE 

uncussified 


Block  1_9 

' This  dissertation  considers  the  problem  of  robustly 
stabilizing  infinite-dimensional  systems  using  finite- 
dimensional  control lers . The  controllers  are  assumed  to  be  linear 
quadratic  Gaussian  (LQG)  based  controllers.  This  research  uses  a 
direct  approach  to  demonstrate  the  existence  of  finite¬ 
dimensional  LQG-based  controllers  that  stabilize  the  nominal 
system.  Once  existence  is  proven,  the  research  focuses  on  mays  to 
analyze  the  robustness  of  the  controller .  > It  is  pointed  out  that 
the  exponential  growth  constant  of  the  semigroup  generated  by 
the  system  ft  operator  is  not  the  only  measure  of  robustness. 

Several  types  of  perturbations  are  considered,  including 
bounded,  relatively  bounded,  additive,  and  multiplicative .  -As— a'^ 
't*eso4fe-,  several  approaches  to  analyzing  robustness  are  developed. 
Direct  analysis  using  results  from  functional  analysis  is 
accomplished,  followed  by  an  approach  called  the  optimal 
projection  equation  approach,  and  then  H-infinity  techniques  are 
used  to  develop  a  sufficient  condition  for  robustness  in  the 
presence  of  multiplicative  perturbations  of  the  plant  transfer 
function., It  is  pointed  out  that  each  approach  can  be  used  to 
account  f ok  different  types  of  perturbations. 

ft  development  in  this  research  is^  new  interpretation  of 
the  linear  quadratic  Gaussian  /  loop  transfer  recovery  technique 

C LQG/LTR ) , f or  the  case  of  reduced  order  control lers .  The_ _ 

technique  can  be  interpreted  as  modeling  system  uncertainty 
through  the  added  noise  term  rather  than  tuning  to  recover  a 
desired  loop  transfer  function. 

ftlso  contained  in  this  research  is  a  sufficient  condition 
for  which  the  LQG/LTR  technique  can  be  extended.  The  development 
of  the  sufficient  condition  is  different  than  approaches  taken  by 
others,  and  may  provide  the  needed  insight  to  extend  the  LQG/LTR 
technique  to  the  class  of  problems  considered  without  any  added 
assumption  being  required,  ft  way  to  approximate  the  LQG/LTR 
technique  is  also  given. 


